System and method of providing voice-message call service

ABSTRACT

Provided are a system and method of providing a voice-message call service. A mobile device that performs a call with an external mobile device comprises a control unit configured to obtain text, the text converted from voice data that is exchanged between the mobile device and the external mobile device, during the call between the mobile device and the external mobile device, and obtain input text input to the mobile device and provided text that is received from the external mobile device; and a display unit configured to arrange the text, the input text, and the provided text and display the arranged text, input text, and provided text on a screen of the device, during the call between the mobile device and the external mobile device.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application priority from Korean Patent Application No.10-2014-0062569, filed on May 23, 2014, and Korean Patent ApplicationNo. 10-2015-0071231, filed on May 21, 2015, in the Korean IntellectualProperty Office, the disclosure of which is incorporated herein byreference in its entirety.

BACKGROUND

1. Field

Aspects of exemplary embodiments relate to a system and method ofproviding a voice-message call service, and more particularly, to asystem and method of providing a voice call and a text service via avoice-message call service.

2. Description of the Related Art

Due to developments in a multimedia technology and a network technology,a user may communicate with another user by using various devices. Inparticular, the user may have a conversation with another user by usinga voice call service and a text messaging service.

However, an environment in which the user may have a conversation withthe other user by using a device, such as a noisy environment or anautomobile environment, may inappropriate for a voice call or a textexchange, respectively.

Accordingly, there is a demand for a technology that allows a user toco-use a voice call service and a text exchange service, or toefficiently switch and use the voice call service and the text exchangeservice.

SUMMARY

Aspects of the exemplary embodiments include a system and method ofproviding a voice-message call service, whereby a voice call and a textservice may be co-provided via the voice-message call service.

Aspects of the exemplary embodiments include a system and method ofproviding a voice-message call service capable of distinguishing betweentexts that indicate a conversation between users during a voice-messagecall.

Aspects of the exemplary embodiments include a system and method ofproviding a voice-message call service capable of advising a user of achange in a call mode during a voice-message call.

Additional aspects will be set forth in part in the description whichfollows and, in part, will be apparent from the description, or may belearned by practice of the presented embodiments.

According to an aspect of an exemplary embodiment, there is provided amobile device that performs a call with an external mobile device, themobile device including a control unit configured to obtain convertedvoice data that is exchanged between the mobile device and the externalmobile device and converted into converted text, during the call betweenthe mobile device and the external mobile device, and obtain input textinput to the mobile device and provided text that is received from theexternal mobile device; and a display unit for arranging the convertedtext, the input text, and the provided text and displaying the arrangedconverted text, input text, and provided text on a screen of the device,during the call between the mobile device and the external mobiledevice.

According to an aspect of an exemplary embodiment, there is provided amethod of a mobile device performing a call with an external mobiledevice, the method including obtaining converted voice data that isexchanged between the mobile device and the external mobile device andconverted into converted text, during the call between the mobile deviceand the external mobile device, obtaining input text that is input tothe device, obtaining provided text that is provided from the externalmobile device, and arranging the converted text, the input text, and theprovided text and displaying the arranged converted text, input text,and provided text on a screen of the device, during the call between themobile device and the external mobile device.

According to an aspect of an exemplary embodiment, there is provided asystem that provides a call between a first mobile device and a secondmobile device, the system including a server including a communicationunit configured to receive a voice of a first user from the first mobiledevice; and a control unit configured to convert the voice of the firstuser into text, wherein the communication unit is further configured totransmit the converted text to the second device; the first mobiledevice configured to provide the voice of the first user to the server;and the second mobile device configured to display the converted text,which is transmitted to the second mobile device, in a chat window thatis displayed on a screen of the second mobile device during the call,wherein the chat window displays a conversation between the first userand a second user.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other aspects will become apparent and more readilyappreciated from the following description of the exemplary embodiments,taken in conjunction with the accompanying drawings in which:

FIG. 1 illustrates a voice-message call service according to anexemplary embodiment;

FIG. 2 is a flowchart of a method of displaying a text that is convertedfrom a voice and a text that is input by a user, the method performed bya first device during a voice-message call, according to an exemplaryembodiment;

FIGS. 3A through 5 illustrate examples in which a voice-message callfunction is activated, according to exemplary embodiments;

FIG. 4 illustrates an example in which a voice-message call function ofthe first device is activated when the first device receives a call,according to an exemplary embodiment;

FIG. 5 illustrates an example in which a voice-message call function ofthe first device is activated during a voice call, according to anexemplary embodiment;

FIG. 6 is a flowchart of a method of performing a voice-message callwith a second device of which voice-message call function is notactivated, the method performed by the first device of whichvoice-message call function is activated, according to an exemplaryembodiment;

FIG. 7 is a flowchart of a method of performing a voice-message call ina mutual manner, the method performed by the first device and the seconddevice, according to an exemplary embodiment;

FIG. 8 is a flowchart of a method of performing a voice-message call ina mutual manner, the method performed by the first device and the seconddevice, according to another exemplary embodiment;

FIG. 9 is a flowchart of a method of performing a voice-message call ina mutual manner, the method performed by the first device and the seconddevice, according to another exemplary embodiment;

FIG. 10 is a flowchart of displaying a chat window during avoice-message call, the method performed by the first device, accordingto an exemplary embodiment;

FIGS. 11A and 11B illustrate examples of a chat window that is displayedduring a voice-message call, according to exemplary embodiments;

FIG. 12 illustrates an example where the first device and the seconddevice exchange a text that is converted from a voice, via a specificchat application, according to an exemplary embodiment;

FIG. 13 is a flowchart of a method of determining a chat application tobe executed by interoperating with a voice call when a voice-messagecall function is activated, the method performed by the first device,according to an exemplary embodiment;

FIG. 14 is a flowchart of a method of determining a chat application tobe used during a voice-message call, the method performed by the firstdevice, according to an exemplary embodiment;

FIG. 15 is a flowchart of a method of installing a chat application tobe used during a voice-message call, the method performed by the firstdevice, according to an exemplary embodiment;

FIG. 16A illustrates an example where the first device activates avoice-message call function while the first device uses a chat service,according to an exemplary embodiment;

FIG. 16B illustrates an example where the first device initiates avoice-message call, according to a user input via a screen of a userslist of a chat application, according to an exemplary embodiment;

FIG. 17 is a flowchart of a method of performing a voice-message callwhile the first device and the second device use a chat service, themethod performed by the first device and the second device, according toan exemplary embodiment;

FIGS. 18 through 21 illustrate examples where a call mode is changedduring a voice-message call, according to exemplary embodiments;

FIG. 22 is a flowchart of a method of switching a mode of avoice-message call, the method performed by the first device, accordingto an exemplary embodiment;

FIG. 23 is a flowchart of a method of performing a voice-message callduring a voice mode, the method performed by the first device, accordingto an exemplary embodiment;

FIG. 24 is a flowchart of a method of performing a voice-message callduring a text mode, the method performed by the first device, accordingto an exemplary embodiment;

FIG. 25 is a flowchart of a method of recognizing a call mode of thesecond device, the method performed by the first device, according to anexemplary embodiment;

FIG. 26 is a flowchart of a method of performing a voice-message call,the method performed by the first device that operates in a voice modeand the second device that operates in a text mode, according to anexemplary embodiment;

FIG. 27 is a flowchart of a method of performing a voice-message call,the method performed by the first device that operates in a voice modeand the second device that operates in a text mode, according to anexemplary embodiment;

FIG. 28 is a flowchart of a method of performing a voice-message call,the method performed by the first device that operates in a voice modeand the second device that operates in a text mode, according to anexemplary embodiment;

FIGS. 29A, 29B, and 29C illustrate examples of a combination mode thatis one of call modes of a voice-message call, according to exemplaryembodiments;

FIG. 30 illustrates an example where a call mode of the first devicethat performs a voice-message call is switched from a voice mode to acombination mode or is switched from the combination mode to the voicemode, according to an exemplary embodiment;

FIG. 31 illustrates an example where a call mode of the first devicethat performs a voice-message call is switched from a text mode to acombination mode or is switched from the combination mode to the textmode, according to an exemplary embodiment;

FIG. 32 is a flowchart of a method of switching a mode of avoice-message call, the method performed by the first device, accordingto an exemplary embodiment;

FIG. 33 is a flowchart of a method of performing a voice-message callduring a combination mode, the method performed by the first device,according to an exemplary embodiment;

FIG. 34 is a flowchart of a method of performing a voice-message callwith the second device, the method performed by the first device thatoperates in a combination mode, according to an exemplary embodiment;

FIG. 35A is a flowchart of a method of advising a first user of a changein a call mode of the second device, and recommending a first user tochange a call mode, the method performed by the first device, accordingto an exemplary embodiment;

FIG. 35B is a flowchart of a method of advising a first user of a changein input/output functions of the second device during a combinationmode, and recommending the first user to change a call mode, the methodperformed by the first device, according to an exemplary embodiment;

FIG. 36 illustrates an example where the first device recommends a firstuser to change a call mode from a voice mode to a text mode, accordingto an exemplary embodiment;

FIG. 37 illustrates an example where the first device recommends a firstuser to change a call mode from a text mode to a voice mode, accordingto an exemplary embodiment;

FIG. 38 is a flowchart of a method of generating a call list in relationto voice-message calls, the method performed by the first device,according to an exemplary embodiment;

FIG. 39 is a flowchart of a method of displaying a text indicating aconversation between a first user and a second user via a call list ofthe first device, according to an exemplary embodiment;

FIGS. 40 through 42 illustrate examples of a call list, according toexemplary embodiments;

FIG. 43 illustrates an example where the first device and the seconddevice perform a voice-message call via the server, according to anexemplary embodiment;

FIG. 44 is a flowchart of a method of supporting a voice-message callbetween the first device and the second device by converting voices offirst and second users into texts, the method performed by the server,according to an exemplary embodiment;

FIG. 45 is a flowchart of a method of supporting a voice-message callbetween the first device and the second device by converting texts offirst and second users into voices, the method performed by the server,according to an exemplary embodiment;

FIG. 46 is a flowchart of a method of storing voice data and text datarelated to a voice-message call between the first device and the seconddevice, the method performed by the server, according to an exemplaryembodiment;

FIG. 47 illustrates in example where the first device, the seconddevice, and a third device perform a voice-message call with each other,according to an exemplary embodiment;

FIG. 48 illustrates an example where the first device, the seconddevice, and the third device perform a voice-message call with eachother via the server, according to an exemplary embodiment;

FIGS. 49 and 50 are block diagrams of the first device, according toexemplary embodiments; and

FIG. 51 is a block diagram of the server, according to an exemplaryembodiment.

DETAILED DESCRIPTION

Hereinafter, exemplary embodiments will be described more fully withreference to the accompanying drawings. However, the exemplaryembodiments may be embodied in many different forms and should not beconstrued as being limited to the exemplary embodiments set forthherein; rather, these exemplary embodiments are provided so that thisdisclosure will be thorough and complete, and will fully convey theconcept of the exemplary embodiments to those of ordinary skill in theart. In the following description, well-known functions or constructionswill not be described in detail not to obscure the exemplary embodimentswith unnecessary detail. Also, throughout the specification, likereference numerals in the drawings denote like elements.

Throughout the specification, it will also be understood that when anelement is referred to as being “connected to” another element, it canbe directly connected to the other element, or electrically connected tothe other element while intervening elements may also be present.

Throughout the specification, a voice-message call service may indicatea service that co-provides a voice call service and a chat (messaging)service. A user may perform a voice call with a user of another deviceby using a device, and may also exchange a message with the user of theother device during the voice call. For example, a call mode of thevoice-message call service may include at least two selected from avoice mode, a text mode, and a combination mode.

Throughout the specification, the voice mode may indicate a call modeduring which a user may perform a voice call with another user.

Throughout the specification, the text mode may indicate a call modeduring which a user may communicate with another user via an exchange ofa text message.

Throughout the specification, the combination mode may indicate a callmode during which a user may perform a voice call with another user andmay simultaneously exchange a text message with the other user using asingle call connection (session) of the call mode.

For one example, during the combination mode, the user may perform avoice call with the other user by using a speakerphone function of adevice and may simultaneously communicate with the other user byexchanging a text message with the other user over the samecommunication connection. For another example, during the combinationmode, the user may perform a voice call with the other user withoutusing the speakerphone function and may simultaneously communicate withthe other user by exchanging a text message with the other user over thesame communication connection.

Also, various techniques may be used to transmit voice data and textdata between devices. For example, voice data or text data may betransmitted and received between the devices by using a mobilecommunication service of which the user is a member or wirelesstechniques (e.g., Wi-Fi or Bluetooth) that may be used in the devices.For example, when an LTE or a Wi-Fi communication technology is used,voice data and text data may both be transmitted and received betweenthe devices via a packet network. In this case, the voice data may betransmitted by using a VoLTE technology. Alternatively, when WCDMA isused, voice data may be transmitted via a circuit network and text datamay be transmitted via a packet network. The voice data and the textdata may be transmitted over separate communication connections. Whenthe packet network is used, a communication connection between thedevices may be a TCP/IP connection. When the circuit network is used,the communication connection between the device may be a callconnection.

As used herein, the term “and/or” includes any and all combinations ofone or more of the associated listed items. Expressions such as “atleast one of,” when preceding a list of elements, modify the entire listof elements and do not modify the individual elements of the list.

Hereinafter, exemplary embodiments will be described more fully withreference to the accompanying drawings.

FIG. 1 illustrates a voice-message call service according to anexemplary embodiment.

Referring to FIG. 1, the first device 1000 may perform a voice-messagecall with a second device 2000. The voice-message call may be initiatedas a single communication connection or session that supports both thevoice service and the messaging service. The first device 1000 and thesecond device 2000 may perform a voice call with each other, and duringthe voice call, the first device 1000 may display a text indicating aconversation between users on a screen of the first device 1000. Also,during the voice call, the second device 2000 may also display the textindicating the conversation between the users on a screen of the seconddevice 2000. For example, the first device 1000 and the second device2000 may display chat windows showing the conversation between the userson the screens of the first device 1000 and the second device 2000,respectively. The chat window may be a window via which messages aretransmitted and received. The first user of the first device 1000 andthe second user of the second device 2000 may communicate with eachother by inputting messages to the chat window.

Accordingly, the user of the first device 1000 and the user of thesecond device 2000 may co-use a voice call service and a chat serviceduring the voice-message call. In this regard, seamless switchingbetween voice and messaging may be accomplished during the voice-messagecall. Alternatively, both the voice and messaging may be simultaneouslyperformed during the voice-message call.

The voice-message call may comprise one or more channels, over whichvoice data and text data may be transmitted. For example, voice data maybe transmitted over a voice channel and text data may be transmittedover a voice channel. Alternatively, a data channel may also be includedin the voice-message call, for transmission of data.

Each of the first device 1000 and the second device 2000 may be, but isnot limited to, a smart phone, a tablet personal computer (PC), a PC, asmart television (TV), a mobile phone, a personal digital assistant(PDA), a laptop computer, a media player, a micro-server, a globalpositioning system (GPS) device, an electronic book terminal, a terminalfor digital broadcasting, a navigation device, a kiosk, an MP3 player, adigital camera, a wearable device, and other mobile or non-mobilecomputing devices. Also, each of the first device 1000 and the seconddevice 2000 may include various devices such as an electronicblackboard, a touch table, etc. that may receive a touch input. Also,each of the first device 1000 and the second device 2000 may be a watch,glasses, a hair band, or a ring that has a communication function and adata processing function.

FIG. 2 is a flowchart of a method of displaying a text that is convertedfrom a voice and a text that is input by a user, the method performed bythe first device 1000 during a voice-message call, according to anexemplary embodiment.

In operation S200, the first device 1000 may activate a voice-messagecall function. When the first device 1000 sends a call to the seconddevice 2000, the first device 1000 may activate the voice-message callfunction. Alternatively, when the first device 1000 receives a call fromthe second device 2000, the first device 1000 may activate thevoice-message call function. Alternatively, while the first device 1000performs a call with the second device 2000, the first device 1000 mayactivate the voice-message call function.

Also, when the voice-message call function is activated, the firstdevice 1000 may advise the second device 2000 that the voice-messagecall function is activated in the first device 1000. In this case, thefirst device 1000 may advise the second device 2000 of a call mode ofthe voice-message call of the first device 1000. The call mode of thevoice-message call will be described at a later time.

Also, when the voice-message call function is activated, varioustechniques may be used to transmit voice data and text data. Forexample, voice data or text data may be transmitted and received betweenthe first device 1000 and the second device 2000 by using a mobilecommunication service of which the user is a member or wirelesstechniques (e.g., Wi-Fi or Bluetooth) that may be used in the devices.For example, when an LTE or a Wi-Fi communication technology is used,voice data and text data may both be transmitted and received betweenthe first devices 1000 and the second device 2000 via a packet network.In this case, the voice data may be transmitted by using a VoLTEtechnology. Alternatively, when WCDMA is used, voice data may betransmitted via a circuit network and text data may be transmitted via apacket network.

The voice data and the text data may be transmitted over separatecommunication connections. When the packet network is used, acommunication connection between the devices may be a TCP/IP connection.When the circuit network is used, the communication connection betweenthe device may be a call connection.

In operation S210, the first device 1000 may obtain texts that areconverted from a voice of a user of the first device 1000 and a voice ofa user of the second device 2000. The first device 1000 may convert thevoice of the user of the first device 1000 into a text and thus mayobtain the converted text. Also, the first device 1000 may receive thevoice of the user of the second device 2000 from the second device 2000,may convert the voice into a text, and thus may obtain the convertedtext. However, a method of obtaining the converted text, the methodperformed by the first device 1000, is not limited thereto. The voice ofthe user of the first device 1000 or the voice of the user of the seconddevice 2000 may be converted into a text by various devices or a serverthat mediates communication between the first device 1000 and the seconddevice 2000, and the first device 1000 may receive the converted textfrom the various devices and the server.

In operation S220, the first device 1000 may obtain a text that is inputby a user. The first device 1000 may obtain a text that is input by theuser of the first device 1000 during the voice-message call. Also,during the voice-message call, the first device 1000 may receive, fromthe second device 2000, a text that is input to the second device 2000by the user of the second device 2000.

In operation S230, the first device 1000 may arrange the converted textsand the input texts in a sequentially temporal order and may display theconverted texts and the input texts on a screen of the first device 1000during a call between the users. The first device 1000 may arrange theconverted texts and the input texts in the temporal order, based oninput times of the voices and the texts. For example, based on a timewhen the user of the first device 1000 inputs the voice into the firstdevice 1000, a time when the user of the second device 2000 inputs thevoice into the second device 2000, a time when the user of the firstdevice 1000 inputs the text into the first device 1000, and a time whenthe user of the second device 2000 inputs the text into the seconddevice 2000, the first device 1000 may arrange the converted texts andthe input texts.

FIGS. 3A through 5 illustrate examples in which a voice-message callfunction is activated, according to exemplary embodiments.

FIG. 3A illustrates an example in which a voice-message call function ofthe first device 1000 is activated when the first device 1000 sends acall, according to an exemplary embodiment.

Referring to FIG. 3A, a user of the first device 1000 may input atelephone number of the second device 2000 and then may select a“voice-message call” button 30. Accordingly, the first device 1000 mayactivate the voice-message call function and may initiate a call to thesecond device 2000.

FIG. 3B illustrates an example in which a voice-message call function ofthe first device 1000 is activated based on a user input of selecting abutton in a phone book that is displayed on a screen of the first device1000, according to an exemplary embodiment.

Referring to FIG. 3B, the first device 1000 may display the phone bookon the screen of the first device 1000, and a user of the first device1000 may select a voice-message call button 32 included in a field of auser list where a telephone number of the second device 2000 isdisplayed, wherein the user list is included in the displayed phonebook. Accordingly, the first device 1000 may activate the voice-messagecall function and may initiate a call to the second device 2000.

FIG. 4 illustrates an example in which a voice-message call function ofthe first device 1000 is activated when the first device 1000 receives acall, according to an exemplary embodiment.

Referring to FIG. 4, when the first device 1000 receives a call from thesecond device 2000, a user of the first device 1000 may select a“voice-message call” button 40. Accordingly, the first device 1000 mayactivate the voice-message call function and may receive the call fromthe second device 2000. Alternatively, when the first device 1000initiates a voice-message call, the second device 2000 may automaticallyaccept the voice-message call.

FIG. 5 illustrates an example in which a voice-message call function ofthe first device 1000 is activated during a voice call, according to anexemplary embodiment.

Referring to FIG. 5, a user of the first device 1000 may select a“voice-message call” button 50 during a voice call with a user of thesecond device 2000. Accordingly, the first device 1000 may activate thevoice-message call function and may perform a voice-message call withthe second device 2000. Alternatively, the second device 2000 mayactivate the voice-message call function during a voice call with thefirst device 1000. In this regard, the call may be initiated as a voicecall, and the voice-message call may be initiated during the voice call.

FIG. 6 is a flowchart of a method of performing a voice-message callwith the second device 2000 of which voice-message call function is notactivated, the method performed by the first device 1000 of whichvoice-message call function is activated, according to an exemplaryembodiment.

Referring to FIG. 6, the first device 1000 of which voice-message callfunction is activated may perform the voice-message call with the seconddevice 2000, and the second device 2000 of which voice-message callfunction is not activated may perform a voice call with the first device1000.

In operation S600, the first device 1000 is call-connected with thesecond device 2000. The first device 1000 may transmit a request forcall-connection to the second device 2000 or may receive a request forcall-connection from the second device 2000, so that the first device1000 may be call-connected with the second device 2000.

In operation S610, the first device 1000 may activate a voice-messagecall function. The first device 1000 may activate the voice-message callfunction, based on a user input, or automatically. In operation S610,the first device 1000 activates the voice-message call function afterthe first device 1000 is call-connected with the second device 2000.However, one or more exemplary embodiments are not limited thereto. Forexample, the first device 1000 may activate the voice-message callfunction when the first device 1000 sends a call or receives a call, orwhile the first device 1000 performs a call.

In operation S620, the first device 1000 may transmit a voice of a userof the first device 1000 (hereinafter, the user of the first device 1000is referred as a first user of the first device 1000) to the seconddevice 2000. The first device 1000 may obtain the voice of the firstuser via a microphone, and may transmit the obtained voice to the seconddevice 2000.

In operation S630, the first device 1000 may convert the voice of thefirst user into a text. The first device 1000 may convert the voice ofthe first user into the text by using various Speech-To-Text (STT)techniques.

In operation S640, the first device 1000 may receive a voice of a userof the second device 2000 (hereinafter, the user of the second device2000 is referred as a second user of the second device 2000) from thesecond device 2000. In this case, the second device 2000 may obtain thevoice of the second user by using a microphone in the second device2000, and may transmit the obtained voice of the second user to thefirst device 1000.

In operation S650, the first device 1000 may convert the voice of thesecond user into a text. The first device 1000 may convert the voice ofthe second user into the text by using the various STT techniques.

In operation S660, the first device 1000 may arrange the converted textsin a temporal order. For example, the first device 1000 may arrange thetext converted from the voice of the first user and the text convertedfrom the voice of the second user, according to a time when the voice ofthe first user is input to the first device 1000 and a time when thevoice of the second user is received. Also, for example, the firstdevice 1000 may arrange the text converted from the voice of the firstuser and the text converted from the voice of the second user, accordingto the time when the voice of the first user is input to the firstdevice 1000 and a time when the voice of the second user is input to thesecond device 2000. However, one or more exemplary embodiments are notlimited thereto.

In operation S670, the first device 1000 may display a chat windowincluding the arranged texts on a screen of the first device 1000. Thefirst device 1000 may display the chat window on the screen of the firstdevice 1000 while the first device 1000 performs the voice-message call.Also, the first device 1000 may display the chat window on the screen ofthe first device 1000 or may hide the chat window in the screen of thefirst device 1000, depending on a call mode of the voice-message call.

FIG. 7 is a flowchart of a method of performing a voice-message call ina mutual manner, the method performed by the first device 1000 and thesecond device 2000, according to an exemplary embodiment. In theembodiment of FIG. 7, the first device 1000 may convert a voice of afirst user and a voice of a second user into texts, and the seconddevice 2000 may convert the voice of the first user and the voice of thesecond user into the texts.

In operation S700, the first device 1000 and the second device 2000 arecall-connected with each other. The first device 1000 may becall-connected with the second device 2000 by transmitting a request forcall-connection to the second device 2000, or by receiving a request forcall-connection from the second device 2000.

In operation S705, the first device 1000 may activate a voice-messagecall function. The first device 1000 may activate the voice-message callfunction, based on a user input. In operation S705, the first device1000 activates the voice-message call function after the first device1000 is call-connected with the second device 2000. However, one or moreexemplary embodiments are not limited thereto. For example, the firstdevice 1000 may activate the voice-message call function when the firstdevice 1000 sends a call or receives a call, or while the first device1000 performs a call.

In operation S710, the second device 2000 may activate a voice-messagecall function. The second device 2000 may activate the voice-messagecall function, based on a user input. In operation S710, the seconddevice 2000 activates the voice-message call function after the seconddevice 2000 is call-connected with the first device 1000. However, oneor more exemplary embodiments are not limited thereto. For example, thesecond device 2000 may activate the voice-message call function when thesecond device 2000 sends a call or receives a call, or while the seconddevice 2000 performs a call.

In operation S715, the first device 1000 may transmit the voice of thefirst user to the second device 2000. The first device 1000 may obtainthe voice of the first user via a microphone in the first device 1000,and may transmit the obtained voice to the second device 2000.

In operation S720, the first device 1000 may convert the voice of thefirst user into a text. The first device 1000 may convert the voice ofthe first user into the text by using various STT techniques.

In operation S725, the second device 2000 may convert the voice of thefirst user, which is received from the first device 1000, into a text.The second device 2000 may convert the voice of the first user into thetext by using the various STT techniques.

In operation S730, the second device 2000 may transmit the voice of thesecond user to the first device 1000. The second device 2000 may obtainthe voice of the second user via a microphone in the second device 2000,and may transmit the obtained voice to the first device 1000.

In operation S735, the first device 1000 may convert the voice of thesecond user, which is received from the second device 2000, into a text.The first device 1000 may convert the voice of the second user into thetext by using various STT techniques.

In operation S740, the second device 2000 may convert the voice of thesecond user into a text. The second device 2000 may convert the voice ofthe second user into the text by using various STT techniques.

In operation S745, the first device 1000 may arrange the converted textsin a temporal order. For example, the first device 1000 may arrange thetext converted from the voice of the first user and the text convertedfrom the voice of the second user, according to a time when the voice ofthe first user is input to the first device 1000 and a time when thevoice of the second user is received. Also, for example, the firstdevice 1000 may sequentially arrange the text converted from the voiceof the first user and the text converted from the voice of the seconduser, according to the time when the voice of the first user is input tothe first device 1000 and a time when the voice of the second user isinput to the second device 2000. However, one or more exemplaryembodiments are not limited thereto.

In operation S750, the second device 2000 may arrange the convertedtexts in a temporal order. For example, the second device 2000 maysequentially arrange the text converted from the voice of the first userand the text converted from the voice of the second user, according to atime when the voice of the second user is input to the second device2000 and a time when the voice of the first user is received. Also, forexample, the second device 2000 may arrange the text converted from thevoice of the first user and the text converted from the voice of thesecond user, according to the time when the voice of the second user isinput to the second device 2000 and a time when the voice of the firstuser is input to the first device 1000. However, one or more exemplaryembodiments are not limited thereto.

In operation S755, the first device 1000 may display a chat windowincluding the arranged texts on a screen of the first device 1000. Thefirst device 1000 may display the chat window on the screen of the firstdevice 1000 while the first device 1000 performs the voice-message call.Also, the first device 1000 may display the chat window on the screen ofthe first device 1000 or may hide the chat window in the screen of thefirst device 1000, depending on a call mode of the voice-message call.

In operation S760, the second device 2000 may display a chat windowincluding the arranged texts on a screen of the second device 2000. Thesecond device 2000 may display the chat window on the screen of thesecond device 2000 while the second device 2000 performs thevoice-message call. Also, the second device 2000 may display the chatwindow on the screen of the second device 2000 or may hide the chatwindow in the screen of the second device 2000, depending on a call modeof the voice-message call.

FIG. 8 is a flowchart of a method of performing a voice-message call ina mutual manner, the method performed by the first device 1000 and thesecond device 2000, according to another exemplary embodiment. In theembodiment of FIG. 8, the first device 1000 may convert a voice of afirst user into a text, and the second device 2000 may convert a voiceof a second user into a text.

In operation S800, the first device 1000 and the second device 2000 arecall-connected with each other.

In operation S805, the first device 1000 may activate a voice-messagecall function, and in operation S810, the second device 2000 mayactivate a voice-message call function. In the embodiment of FIG. 8, thefirst device 1000 and the second device 2000 activate the voice-messagecall functions, respectively, after the first device 1000 and the seconddevice 2000 are call-connected with each other, but one or moreexemplary embodiments are not limited thereto, as the devices 1000 and2000 may automatically initiate voice-message call functions.

In operation S815, the first device 1000 may transmit the voice of thefirst user to the second device 2000. The first device 1000 may obtainthe voice of the first user via a microphone in the first device 1000,and may transmit the obtained voice to the second device 2000.

In operation S820, the first device 1000 may convert the voice of thefirst user into a text. The first device 1000 may convert the voice ofthe first user into the text by using various STT techniques.

In operation S825, the first device 1000 may transmit the text of thefirst user to the second device 2000.

In operation S830, the second device 2000 may transmit the voice of thesecond user to the first device 1000. The second device 2000 may obtainthe voice of the second user via a microphone in the second device 2000,and may transmit the obtained voice to the first device 1000.

In operation S835, the second device 2000 may convert the voice of thesecond user into a text. The second device 2000 may convert the voice ofthe second user into the text by using various the STT techniques.

In operation S840, the second device 2000 may transmit the text of thesecond user to the first device 1000.

In operation S845, the first device 1000 may arrange the converted textand the received text in a temporal order. For example, the first device1000 may arrange the text that is converted by the first device 1000from the voice of the first user and the text of the second user that isreceived from the second device 2000, in the temporal order.

In operation S850, the first device 1000 may display a chat windowincluding the arranged texts on a screen of the first device 1000. Thefirst device 1000 may display the chat window on the screen of the firstdevice 1000 while the first device 1000 performs the voice-message call.

In operation S855, the second device 2000 may arrange the converted textand the received text in a temporal order. For example, the seconddevice 2000 may arrange the text that is converted from the voice of thesecond user by the second device 2000 and the text of the first userthat is received from the first device 1000, in the temporal order.

In operation S860, the second device 2000 may display a chat windowincluding the arranged texts on a screen of the second device 2000. Thesecond device 2000 may display the chat window on the screen of thesecond device 2000 while the second device 2000 performs thevoice-message call.

FIG. 9 is a flowchart of a method of performing a voice-message call ina mutual manner, the method performed by the first device 1000 and thesecond device 2000, according to another exemplary embodiment. In theembodiment of FIG. 9, the first device 1000 may convert a voice of afirst user and a voice of a second user into texts.

Operations S900 through S930 of FIG. 9 correspond to operations S800through S830 of FIG. 8, thus, detailed descriptions thereof are omittedhere.

In operation S935, the first device 1000 may convert the voice of thesecond user into the text. The first device 1000 may convert the voiceof the second user into the text by using various STT techniques.

In operation S940, the first device 1000 may transmit the text of thesecond user to the second device 2000.

In operation S945, the first device 1000 may arrange the converted textsin a temporal order. For example, the first device 1000 may arrange thetext that is converted by the first device 1000 from the voice of thefirst user and the text that is converted by the first device 1000 fromthe voice of the second user, in the temporal order.

In operation S950, the first device 1000 may display a chat windowincluding the arranged texts on a screen of the first device 1000. Thefirst device 1000 may display the chat window on the screen of the firstdevice 1000 while the first device 1000 performs the voice-message call.

In operation S955, the second device 2000 may arrange the convertedtexts in a temporal order. The second device 2000 may arrange the textof the first user that is received from the first device 1000 and thetext of the second user, in the temporal order.

In operation S960, the second device 2000 may display a chat windowincluding the arranged texts on a screen of the second device 2000. Thesecond device 2000 may display the chat window on the screen of thesecond device 2000 while the second device 2000 performs thevoice-message call.

FIG. 10 is a flowchart of displaying a chat window during avoice-message call, the method performed by the first device 1000,according to an exemplary embodiment.

In operation S1000, the first device 1000 may activate a voice-messagecall function. When the first device 1000 initiates a call to the seconddevice 2000, the first device 1000 may activate the voice-message callfunction. Alternatively, when the first device 1000 receives a call fromthe second device 2000, the first device 1000 may activate thevoice-message call function. Alternatively, while the first device 1000performs a call with the second device 2000, the first device 1000 mayactivate the voice-message call function.

In operation S1010, the first device 1000 may obtain texts that areconverted from a voice of a first user and a voice of a second user. Thefirst device 1000 may convert a voice of a user of the first device 1000into a text and thus may obtain the converted text. Also, the firstdevice 1000 may receive a voice of a user of the second device 2000 fromthe second device 2000, may convert the received voice into a text, andthus may obtain the converted text. However, a method of obtaining aconverted text, the method performed by the first device 1000, is notlimited thereto. The voice of the user of the first device 1000 and thevoice of the user of the second device 2000 may be converted into thetexts by various devices or a server, and the first device 1000 mayreceive the converted texts from the various devices and the server. Forexample, the texts may be received from the device 2000 or the server,which may mediate a communication session between the first device 1000and the second device 2000.

In operation S1020, the first device 1000 may back up original voicedata of the converted texts. The first device 1000 may back up voicedata of the first user that corresponds to the text that is convertedfrom the voice of the first user. Also, the first device 1000 may backup voice data of the second user that corresponds to the text that isconverted from the voice of the second user.

In operation S1030, the first device 1000 may display a chat window on ascreen of the first device 1000 during a call between the first user andthe second user. The first device 1000 may display the chat window onthe screen of the first device 1000 to show contents of a conversationbetween the first user and the second user.

In operation S1040, the first device 1000 may obtain a text that isinput by the first user via the chat window. Also, the first device 1000may receive, from the second device 2000, a text that the second userinputs to the second device 2000 during the voice-message call.

In operation S1050, the first device 1000 may arrange the convertedtexts and the input texts in a temporal order and may display them inthe chat window. The first device 1000 may arrange the converted textsand the input texts in the temporal order, based on input times of thevoices and the texts. For example, the first device 1000 may arrange theconverted texts and the input texts, based on a time when the first userinputs the voice into the first device 1000, a time when the second userinputs the voice into the second device 2000, a time when the first userinputs the text into the first device 1000, and a time when the seconduser inputs the text into the second device 2000.

In operation S1060, the first device 1000 may distinguish between theconverted texts and the input texts and may display them. The firstdevice 1000 may distinguish the text converted from the voice of thefirst user and the text converted from the voice of the second user fromthe text input by the first user and the text input by the second user,and may display them. In this regard, a user may distinguish text inputby a user and voice input by a user that is converted into text form anddisplayed.

In order to distinctively display the converted texts, the first device1000 may display a separate icon around the converted texts.Alternatively, the first device 1000 may distinctively display a color,a thickness, or a font of the converted texts. However, one or moreexemplary embodiments are not limited thereto.

In operation S1070, when at least one converted text among the convertedtexts is selected, the first device 1000 may output original voice dataof the selected converted text. When the converted text is selected inthe chat window by the first user, the first device 1000 may extract theoriginal voice data of the selected converted text from a memory, andmay output the extracted original voice data via a speaker in the firstdevice 1000.

In operation S1080, the first device 1000 may back up a text among thearranged texts, wherein the text is obtained for a preset time periodbefore a predetermined event occurs. For example, the predeterminedevent may include an end of a call between the first device 1000 and thesecond device 2000, reception of a user input for a text backup, or thelike. For one example, when the call between the first device 1000 andthe second device 2000 ends, the first device 1000 may back up a textthat is obtained by the first device 1000 for five minutes before thecall ends. For another example, when the first device 1000 receives theuser input for the text backup, the first device 1000 may back up a textthat is obtained by the first device 1000 for three minutes before theuser input is received. However, a type of the event and a time valuethat are set for the text backup are not limited thereto.

The first device 1000 may back up all of the arranged texts in a server3000. In this case, the first device 1000 may back up some of thearranged texts in the first device 1000 and may back up all of thearranged texts in the server 3000. Alternatively, the first device 1000may back up some of the arranged texts and all of the arranged texts inthe server 3000.

Referring to FIG. 10, the first device 1000 backs up the text among thearranged texts, wherein the text is obtained for the preset time periodbefore the predetermined event occurs, but one or more exemplaryembodiments are not limited thereto. The first device 1000 may analyze aconversation between the users by performing various naturallanguage-based analyzing methods on all of the arranged texts, and mayextract a part from the arranged texts which indicates importantcontents of the conversation between the users. Also, the first device1000 may back up a text indicating the extracted part of theconversation in the first device 1000.

FIGS. 11A and 11B illustrate examples of a chat window that is displayedduring a voice-message call, according to exemplary embodiments.

FIG. 11A indicates an example where a text that is converted from avoice is distinctively displayed in the chat window that is displayedduring the voice-message call, according to an exemplary embodiment.

Referring to FIG. 11A, the chat window may be displayed on a screen ofthe first device 1000 during the voice-message call, and “Sure” and“What are you going?” that are texts converted from a voice of a usermay be displayed in the chat window. Also, in order to indicate that“What are you going?” is the text that is converted from the voice, thefirst device 1000 may display an icon 110 around “What are you going?”.

When a first user touches “What are you going?”, the first device 1000may output original voice data that corresponds to the touched text“What are you going?” via a speaker of the first device 1000. The firstdevice 1000 may output the voice of the user who pronounces “What areyou going?”. In this regard, the original voice of the user may bebuffered by the first device 1000, the second device 2000, or a serverthat mediates a connection between the devices. Accordingly, thebuffered voice may be replayed upon request.

Accordingly, although a typographical error “going” exists in the textthat is converted from the voice of the user, the user may listen to theoriginal voice data of the converted text and thus may further correctlyrecognize contents of user conversation.

Also, the first device 1000 may indicate a level of reliability ofconversion in relation to the text that is converted from the text. Forexample, when reliability of “Sure” is higher than reliability of “Whatare you going?”, a size and a thickness of letters “Sure” may be greaterthan a size and a thickness of letters “What are you going?”. However,one or more exemplary embodiments are not limited thereto, and thus, acolor and a font of the letters “Sure” may be distinctively displayed.Also, a specific object that indicates a value of reliability may bedisplayed around the converted text.

FIG. 11B indicates an example where a text that is converted from avoice is distinctively displayed by a unit of a word in the chat windowthat is displayed during the voice-message call, according to anexemplary embodiment.

Referring to FIG. 11B, the first device 1000 may distinctively displayreliability of “What are you going?” that is a text converted from avoice, by a unit of a word. For example, when reliability of “What” and“you” is higher than reliability of “are” and “going” in the text “Whatare you going?”, a size and a thickness of letters “What” and “you” maybe displayed greater than a size and a thickness of letters “are” and“going”. However, one or more exemplary embodiments are not limitedthereto, and thus, a color and a font of the letters “What” and “you”may be distinctively displayed.

Also, when a first user touches “What” of “What are you going?”, thefirst device 1000 may output original voice data that corresponds to atouched word “What” via a speaker of the first device 1000. The firstdevice 1000 may output a voice of a user who pronounces the word “What”.Accordingly, a user may selectively request voice corresponding to aportion of a text message to be replayed.

FIG. 12 illustrates an example where the first device 1000 and thesecond device 2000 exchange a text that is converted from a voice, via aspecific chat application, according to an exemplary embodiment.

Referring to FIG. 12, a chat application 120 may be executed in thefirst device 1000, and a chat application 122 may be executed in thesecond device 2000. The chat application 120 and the chat application122 may be same applications or may be compatible with each other.

Also, the first device 1000 may input a text that is converted from avoice and is obtained by the first device 1000 into the chat application120, and may transmit the input text to the chat application 122 of thesecond device 2000 via the chat application 120.

Also, the second device 2000 may input a text that is converted from avoice and is obtained by the second device 2000 into the chatapplication 122, and may transmit the input text to the chat application120 of the first device 1000 via the chat application 122.

FIG. 13 is a flowchart of a method of determining a chat application tobe executed by interoperating with a voice call when a voice-messagecall function is activated, the method performed by the first device1000, according to an exemplary embodiment.

In operation S1300, the first device 1000 may activate the voice-messagecall function. When the first device 1000 sends a request to initiatethe call to the second device 2000, the first device 1000 may activatethe voice-message call function. Alternatively, when the first device1000 receives a call from the second device 2000, the first device 1000may activate the voice-message call function. Alternatively, while thefirst device 1000 performs a call with the second device 2000, the firstdevice 1000 may activate the voice-message call function.

In operation S1310, the first device 1000 may determine a chatapplication. The first device 1000 may determine the chat application tobe used during a voice-message call. For one example, the first device1000 may determine a chat application that is executable byinteroperating with the voice-message call function of the first device1000, as the chat application to be used during the voice-message call.For another example, the first device 1000 may determine a chatapplication that is installed in all of the first device 1000 and thesecond device 2000, as the chat application to be used during thevoice-message call. However, one or more exemplary embodiments are notlimited thereto. Alternatively, a user may select a chant application tobe executed from among one or more chat applications when a call isinitiated or a call request is received, as discussed below.

In operation S1320, the first device 1000 may execute the determinedchat application, and in operation S1325, the first device 1000 mayinput a text, which is converted from a voice, into the executed chatapplication. For example, the first device 1000 may install a plug-infor a text automatic input in the executed chat application, and mayinput the text converted from the voice into the chat application viathe installed plug-in. However, one or more exemplary embodiments arenot limited thereto.

In operation S1330, the first device 1000 may display a chat window on ascreen of the first device 1000 during a call between users. The firstdevice 1000 may arrange, in the chat window, a text that is convertedfrom a voice of the first user, a text that is input to the first device1000 by the first user, a text that is converted from a voice of asecond user, and a text that is input to the second device 2000 by thesecond user.

Also, the first device 1000 may display the chat window on the screen ofthe first device 1000 or may hide the chat window in the screen of thefirst device 1000, depending on a call mode of the voice-message call.

FIG. 14 is a flowchart of a method of determining a chat application tobe used during a voice-message call, the method performed by the firstdevice 1000, according to an exemplary embodiment.

In operation S1400, the first device 1000 may request the second device2000 for a list of chat applications installed in the second device2000, and in operation S1410, the second device 2000 may provide thelist of the chat applications installed in the second device 2000 to thefirst device 1000.

In operation S1420, the first device 1000 may select a chat applicationamong chat applications that are installed in the first device 1000,wherein the chat application is compatible with a chat application amongthe chat applications in the list that is received from the seconddevice 2000.

For one example, a chat application that is compatible with a chatapplication ‘A’ may be a same chat application as the chat application‘A’. Also, for another example, the chat application that is compatiblewith the chat application ‘A’ may be chat application that is differentfrom the chat application ‘A’ but is capable of exchanging a messagewith the chat application ‘A’.

Referring to FIG. 14, the first device 1000 requests the second device2000 for the list of the chat applications and thus receives the list ofthe chat applications from the second device 2000, but one or moreexemplary embodiments are not limited thereto. When the first device1000 and the second device 2000 are connected for a voice-message call,the first device 1000 may receive the list of the chat applications fromthe second device 2000 without a separate request.

FIG. 15 is a flowchart of a method of installing a chat application tobe used during a voice-message call, the method performed by the firstdevice 1000, according to an exemplary embodiment.

In operation S1500, the first device 1000 may request the second device2000 for a list of chat applications installed in the second device2000, and in operation S1510, the second device 2000 may provide thelist of the chat applications installed in the second device 2000 to thefirst device 1000.

In operation S1520, the first device 1000 may install a chat applicationthat is compatible with a chat application included in the list of thechat applications received from the second device 2000. The first device1000 may select the chat application that is compatible with the chatapplication included in the list of the chat applications received fromthe second device 2000, and may download the selected chat applicationfrom a predetermined server or the second device 2000. Also, the firstdevice 1000 may install the downloaded chat application in the firstdevice 1000.

Referring to FIG. 15, the first device 1000 requests the second device2000 for the list of the chat applications and thus receives the list ofthe chat applications from the second device 2000, but one or moreexemplary embodiments are not limited thereto. When the first device1000 and the second device 2000 are connected for a voice-message call,the first device 1000 may receive the list of the chat applications fromthe second device 2000 without a separate request.

FIG. 16A illustrates an example where the first device 1000 activates avoice-message call function while the first device 1000 uses a chatservice, according to an exemplary embodiment.

Referring to FIG. 16A, the first device 1000 may execute a chatapplication and may use a predetermined chat service. Also, when a firstuser selects a button 160 displayed on an execution screen of the chatapplication, the first device 1000 may activate the voice-message callfunction.

FIG. 16B illustrates an example where the first device 1000 initiates avoice-message call, according to a user input via a screen of a userslist of a chat application, according to an exemplary embodiment.

Referring to FIG. 16B, the first device 1000 may execute the chatapplication and may display the users list of the chat application.Also, the first device 1000 may receive a user input of selecting abutton 165 for a voice call with “John” in the users list. Accordingly,the first device 1000 may initiate a voice-message call with a John'sdevice.

FIG. 17 is a flowchart of a method of performing a voice-message callwhile the first device 1000 and the second device 2000 use a chatservice, the method performed by the first device 1000 and the seconddevice 2000, according to an exemplary embodiment.

In operation S1700, the first device 1000 and the second device 2000 areconnected with each other for communication for a chat service. Also, inoperation S1710, the first device 1000 may display a chat window on ascreen of the first device 1000, and in operation S1720, the seconddevice 2000 may display a chat window on a screen of the second device2000. Afterward, the first device 1000 and the second device 2000 mayexchange a message.

In operation S1730, the first device 1000 may activate a voice-messagecall function, and in operation S1740, the second device 2000 mayactivate a voice-message call function.

Also, in operation S1750, the first device 1000 and the second device2000 may perform a voice-message call with each other.

FIGS. 18 through 21 illustrate examples where a call mode is changedduring a voice-message call, according to exemplary embodiments.

The call mode of the voice-message call may include a voice mode and atext mode. The voice mode may indicate a mode during which a user mayperform a voice call with another user, and the text mode may indicate amode during which the user may communicate with the other user via anexchange of a text message.

FIG. 18 illustrates an example where the first device 1000 automaticallyswitches the call mode from the voice mode to the text mode during thevoice-message call, according to an exemplary embodiment.

Referring to FIG. 18, when the first device 1000 is adjacent to a user'sface, the first device 1000 may deactivate a screen of the first device1000 and may operate in the voice mode. Afterward, when the first device1000 is distant from the user's face, the first device 1000 may switchthe call mode from the voice mode to the text mode and may display achat window on the screen of the first device 1000. The first device1000 may automatically detect orientation and position of the firstdevice, and switch between the voice mode and the text mode asnecessary.

FIG. 19 illustrates an example where the first device 1000 automaticallyswitches the call mode from the text mode to the voice mode during thevoice-message call, according to an exemplary embodiment.

Referring to FIG. 19, when the first device 1000 is distant from auser's face, the first device 1000 may display a chat window on a screenof the first device 1000 and may operate in the text mode. Afterward,when the first device 1000 approaches the user's face, the first device1000 may switch the call mode from the text mode to the voice mode andmay deactivate the screen of the first device 1000. Again, the firstdevice 1000 may automatically detect orientation and position of thefirst device, and switch between the voice mode and the text mode asnecessary.

FIG. 20 illustrates an example where the first device 1000 manuallyswitches the call mode from the voice mode to the text mode during thevoice-message call, according to an exemplary embodiment.

Referring to FIG. 20, while the first device 1000 operates in the voicemode, when a first user selects a button 200 displayed on a screen ofthe first device 1000, the first device 1000 may switch the call modefrom the voice mode to the text mode and may display a chat window onthe screen of the first device 1000.

FIG. 21 illustrates an example where the first device 1000 manuallyswitches the call mode from the text mode to the voice mode during thevoice-message call, according to an exemplary embodiment.

Referring to FIG. 21, while the first device 1000 operates in the textmode, when a first user selects a button 210 displayed on a screen ofthe first device 1000, the first device 1000 may switch the call modefrom the text mode to the voice mode and may inactivate the screen ofthe first device 1000.

FIG. 22 is a flowchart of a method of switching a mode of avoice-message call, the method performed by the first device 1000,according to an exemplary embodiment.

In operation S2200, the first device 1000 may determine whether a callmode of the voice-message call is a voice mode. For one example, thefirst device 1000 may determine whether the first device 1000 isadjacent to a face of a first user by using a proximity sensor in thefirst device 1000, and thus may determine whether the call mode is thevoice mode. For another example, the first device 1000 may determinewhether a button for switching to the voice mode is selected by thefirst user, and thus may determine whether the call mode is the voicemode.

As a result of the determination in operation S2200, when the firstdevice 1000 determines that the call mode is the voice mode, inoperation S2210, the first device 1000 may activate a speaker and amicrophone. Accordingly, the first device 1000 may obtain a voice of thefirst user via the activated microphone, and may output a voice of asecond user via the activated speaker.

In operation S2220, the first device 1000 hides a chat window in ascreen of the first device 1000. For example, the first device 1000 mayhide the chat window in the screen of the first device 1000 bydeactivating the screen of the first device 1000. Though the screen isdeactivated, the first device 1000 may still buffer text equivalents ofthe voice conversation, in event the voice mode is switched to the textmode. The text equivalents may be buffered at the first device 1000,second device 2000, or a server.

As a result of the determination in operation S2200, if the call mode isnot the voice mode, in operation S2230, the first device 1000 maydetermine whether the call mode of the voice-message call is a textmode. For one example, the first device 1000 may determine whether thefirst device 1000 is distant from the face of the first user by usingthe proximity sensor in the first device 1000, and thus may determinewhether the call mode is the text mode. For another example, the firstdevice 1000 may determine whether a button for switching to the textmode is selected by the first user, and thus may determine whether thecall mode is the text mode.

As a result of the determination in operation S2230, when the firstdevice 1000 determines that the call mode is the text mode, in operationS2240, the first device 1000 may activate the speaker and themicrophone.

In operation S2250, the first device 1000 may display the chat window onthe screen of the first device 1000. Also, the first device 1000 maydisplay, in the chat window, a text that is input by the first user viathe chat window. Also, the first device 1000 may display, in the chatwindow, a text that is converted from the voice of the second user and atext that is input to the second device 2000 by the second user.

In operation S2260, the first device 1000 may determine whether the callmode is switched. In operation S2260, if the first device 1000determines that the call mode is switched, the first device 1000 mayperform operation S2200.

FIG. 23 is a flowchart of a method of performing a voice-message callduring a voice mode, the method performed by the first device 1000,according to an exemplary embodiment.

In operation S2300, the first device 1000 may determine whether thefirst device 1000 is adjacent to a face of a first user. The firstdevice 1000 may determine whether the first device 1000 is adjacent tothe face of the first user by using a proximity sensor included in thefirst device 1000.

In operation S2310, the first device 1000 may activate a speaker and amicrophone. The first device 1000 may determine that a call mode of thevoice-message call is a voice mode, and thus may activate the speakerand the microphone in the first device 1000. Accordingly, the firstdevice 1000 may receive an input of a voice of the first user via themicrophone, and may output a voice of a second user via the speaker.

In operation S2320, the first device 1000 may convert the voice that isinput from the first user into a text. The first device 1000 may convertthe voice of the first user into the text by using various STTtechniques.

In operation S2330, the first device 1000 hides a chat window in ascreen of the first device 1000. The first device 1000 may hide the chatwindow in the screen of the first device 1000 by deactivating the screenof the first device 1000.

In operation S2340, the first device 100 may recognize a call mode ofthe second device 2000. The second device 2000 may transmit informationindicating the call mode of the second device 2000 to the first device1000, and the first device 1000 may recognize the call mode of thesecond device 2000, based on the information indicating the call modethat is received from the second device 2000.

In operation S2350, the first device 1000 may selectively transmit, tothe second device 2000, at least one of the voice that is input by thefirst user and the text that is converted from the voice input by thefirst user. For one example, when the call mode of the second device2000 is a voice mode, the first device 1000 may transmit the voice thatis input by the first user to the second device 2000. For anotherexample, when the call mode of the second device 2000 is a text mode,the first device 1000 may transmit, to the second device 2000, the textthat is converted from the voice input by the first user. However, oneor more exemplary embodiments are not limited thereto.

FIG. 24 is a flowchart of a method of performing a voice-message callduring a text mode, the method performed by the first device 1000,according to an exemplary embodiment.

In operation S2400, the first device 1000 may determine whether thefirst device 1000 is distant from a face of a first user. The firstdevice 1000 may determine whether the first device 1000 is distant fromthe face of the first user by using a proximity sensor included in thefirst device 1000.

In operation S2410, the first device 1000 may inactivate a speaker and amicrophone. The first device 1000 may determine that a call mode of thevoice-message call is a text mode, and thus may deactivate the speakerand the microphone.

In operation S2420, the first device 1000 may display a chat window on ascreen of the first device 1000. The first device 1000 may display, onthe screen of the first device 1000, the chat window that shows aconversation between the first user and the second user.

In operation S2430, the first device 1000 may convert a text that isinput by the first user into a voice. The first device 1000 may convertthe text of the first user into the voice by using variousText-To-Speech (TTS) techniques. In this case, the first device 1000 maydetermine a tone of the converted voice of the first user, inconsideration of a gender, an age, etc. of the first user.

In operation S2440, the first device 1000 may recognize a call mode ofthe second device 2000. The second device 2000 may transmit informationindicating the call mode of the second device 2000 to the first device1000, and the first device 1000 may recognize the call mode of thesecond device 2000, based on the information indicating the call modethat is received from the second device 2000.

In operation S2450, the first device 1000 may selectively transmit, tothe second device 2000, at least one of the text that is input by thefirst user and the voice that is converted from the text input by thefirst user. For one example, when the call mode of the second device2000 is a voice mode, the first device 1000 may transmit the voice thatis converted from the text input by the first user to the second device2000. For another example, when the call mode of the second device 2000is a text mode, the first device 1000 may transmit the text that isinput by the first user to the second device 2000. However, one or moreexemplary embodiments are not limited thereto.

FIG. 25 is a flowchart of a method of recognizing a call mode of thesecond device 2000, the method performed by the first device 1000,according to an exemplary embodiment.

In operation S2500, the first device 1000 may request the second device2000 for the call mode of the second device 2000. The first device 1000may periodically request the second device 2000 for the call mode of thesecond device 2000, but one or more exemplary embodiments are notlimited thereto. Alternatively, the first device 1000 may automaticallyrequest the second device 2000 for the call mode upon initiation of acall.

Also, in operation S2510, the second device 2000 may recognize its callmode, and in operation S2520, the second device 2000 may transmitinformation about the call mode of the second device 2000 to the firstdevice 1000.

Referring to FIG. 25, the second device 2000 transmits the informationabout the call mode of the second device 2000, in response to therequest by the first device 1000, but one or more exemplary embodimentsare not limited thereto. For example, although the second device 2000does not receive the request from the first device 1000, when the callmode of the second device 2000 is changed, the second device 2000 maytransmit information about the changed call mode of the second device2000 to the first device 1000.

In operation S2530, the first device 1000 may recognize the call mode ofthe second device 2000. The first device 1000 may recognize whether thecall mode of the second device 2000 is a voice mode or a text mode,based on the information about the call mode of the second device 2000which is received from the second device 2000.

In operation S2540, the first device 1000 may selectively transmit avoice of a first user or a text of the first user to the second device2000. For one example, when the call mode of the second device 2000 isthe voice mode, the first device 1000 may transmit the voice of thefirst user to the second device 2000. For another example, when the callmode of the second device 2000 is the text mode, the first device 1000may transmit the text of the first user to the second device 2000.

FIG. 26 is a flowchart of a method of performing a voice-message call,the method performed by the first device 1000 that operates in a voicemode and the second device 2000 that operates in a text mode, accordingto an exemplary embodiment. In the embodiment of FIG. 26, the firstdevice 1000 may convert a voice of a first user into a text, and thesecond device 2000 may convert a text of a second user into a voice.

In operation S2600, the first device 1000 and the second device 2000 arecall-connected with each other. The first device 1000 may transmit arequest for call-connection to the second device 2000 or may receive acall for call-connection from the second device 2000, so that the firstdevice 1000 may be call-connected with the second device 2000.

In operation S2605, the first device 1000 may activate a voice-messagecall function. The first device 1000 may activate the voice-message callfunction, based on a user input. In operation S2605, the first device1000 activates the voice-message call function after the first device1000 is call-connected with the second device 2000. However, one or moreexemplary embodiments are not limited thereto. For example, the firstdevice 1000 may activate the voice-message call function when the firstdevice 1000 sends a call or receives a call, or while the first device1000 performs a call.

In operation S2610, the second device 2000 may activate a voice-messagecall function. The second device 2000 may activate the voice-messagecall function, based on a user input. In operation S2610, the seconddevice 2000 activates the voice-message call function after the seconddevice 2000 is call-connected with the first device 1000. However, oneor more exemplary embodiments are not limited thereto. For example, thesecond device 2000 may activate the voice-message call function when thesecond device 2000 sends a call or receives a call, or while the seconddevice 2000 performs a call.

In operation S2615, the first device 1000 may operate in the voice mode.When the first device 1000 approaches a face of the first user orreceives a user input of allowing the first device 1000 to operate inthe voice mode, the first device 1000 may operate in the voice mode.

In operation S2620, the first device 1000 may activate a microphone anda speaker in the first device 1000, and may hide a chat window forshowing a conversation between the first user and the second user in ascreen of the first device 1000.

In operation S2625, the second device 2000 may operate in the text mode.When the second device 2000 is distant from a face of the second user orreceives a user input of allowing the second device 2000 to operate inthe text mode, the second device 2000 may operate in the text mode.

In operation S2630, the second device 2000 may deactivate a speaker anda microphone in the second device 2000, and may display a chat windowfor showing a conversation between the first user and the second user ona screen of the second device 2000.

In operation S2635, the first device 1000 may receive an input of thevoice of the first user, and in operation S2640, the first device 1000may convert the voice of the first user into a text.

In operation S2645, the first device 1000 may transmit, to the seconddevice 2000, the text that is converted from the voice of the firstuser. The first device 1000 may recognize that the second device 2000operates in the text mode, and may transmit the text that is convertedfrom the voice of the first user to the second device 2000.

In operation S2650, the second device 2000 may display the chat windowfor showing the conversation between the first user and the second useron the screen of the second device 2000, and in operation S2655, thesecond device 2000 may receive a text input by the second user via thechat window. Also, the second device 2000 may arrange the text receivedfrom the first device 1000 and the text input to the second device 2000in a temporal order and may display the texts in the chat window.

In operation S2660, the second device 2000 may convert the text of thesecond user into a voice using text-to-speech (TTS). The second device2000 may determine a tone of the voice that is converted from the textof the second user, in consideration of an age and a gender of thesecond user.

In operation S2665, the second device 2000 may transmit, to the firstdevice 1000, the voice that is converted from the text of the seconduser, and the text of the second user.

In operation S2670, the first device 1000 may output the voice that isconverted from the text of the second user, via the speaker of the firstdevice 1000.

FIG. 27 is a flowchart of a method of performing a voice-message call,the method performed by the first device 1000 that operates in a voicemode and the second device 2000 that operates in a text mode, accordingto an exemplary embodiment. In the embodiment of FIG. 27, the firstdevice 1000 may convert a voice of a first user into a text, and mayconvert a text of a second user into a voice. Accordingly, the firstuser may operate in the voice mode, while the second user may operate inthe text mode.

Because operations S2700 through S2755 of FIG. 27 correspond tooperations S2600 through S2655 of FIG. 26, descriptions about operationsS2700 through S2755 are omitted here.

In operation S2760, the second device 2000 may transmit a text that isinput by the second user (i.e., the text of the second user) to thefirst device 1000.

In operation S2765, the first device 1000 may convert the text of thesecond user into a voice. The first device 1000 may convert the text ofthe second user into a voice of the second user by using various TTStechniques. Also, the first device 1000 may previously obtain userinformation about a gender, an age, etc., of the second user, and maydetermine a tone of the voice that is converted from the text of thesecond user, in consideration of the gender, the age, etc., of thesecond user.

In operation S2770, the first device 1000 may output the voice that isconverted from the text of the second user, via a speaker of the firstdevice 1000. Accordingly, the second user may operate in the text mode,while the first user may operate in the voice mode.

FIG. 28 is a flowchart of a method of performing a voice-message call,the method performed by the first device 1000 that operates in a voicemode and the second device 2000 that operates in a text mode, accordingto an exemplary embodiment. In the embodiment of FIG. 28, the seconddevice 2000 may convert a voice of a first user into a text, and mayconvert a text of a second user into a voice.

Since operations S2800 through S2835 of FIG. 28 correspond to operationsS2700 through S2735 of FIG. 27, descriptions about operations S2700through S2735 are omitted here.

In operation S2840, the first device 1000 may transmit the voice of thefirst user to the second device 2000.

In operation S2845, the second device 2000 may convert the voice of thefirst user into a text, and in operation S2850, the second device 2000may display a text indicating a conversation between the first user andthe second user in the chat window. Accordingly, the first user mayoperate in the voice mode and the second user may operate in the textmode.

In operation S2855, the second device 2000 may receive a text input bythe second user via the chat window, and in operation S2860, the seconddevice 2000 may convert the text that is input by the second user (i.e.,the text of the second user) into a voice. For example, the seconddevice 2000 may determine a tone of the converted voice, inconsideration of a gender and an age of the second user.

In operation S2865, the second device 2000 may transmit, to the firstdevice 1000, the voice that is converted from the text of the seconduser, the text that is converted from the voice of the first user, andthe text of the second user.

In operation S2870, the first device 1000 may output the voice that isconverted from the text of the second user, via a speaker of the firstdevice 1000. Accordingly, the first user may operate in the voice modeand the second user may operate in the text mode.

FIGS. 29A, 29B, and 29C illustrate examples of a combination mode thatis one of call modes of a voice-message call, according to exemplaryembodiments.

During the combination mode, while a voice input function and a voiceoutput function for a voice call are activated, a text input functionand a text output function for a text exchange may be activated. Thus,in the combination mode, a user may perform the text exchange while theuser performs the voice call via the first device 1000.

Also, during the combination mode, while at least one of the voice inputfunction and the voice output function for the voice call are activated,at least one of the text input function and the text output function forthe text exchange may be activated.

For one example, during the combination mode, while the voice inputfunction for the voice call is activated, the text input function andthe text output function for the text exchange may be activated.

For another example, during the combination mode, while the voice outputfunction for the voice call is activated, the text input function andthe text output function for the text exchange may be activated.

For another example, during the combination mode, while the voice inputfunction and the voice output function for the voice call are activated,the text input function for the text exchange may be activated.

For another example, during the combination mode, while the voice inputfunction and the voice output function for the voice call are activated,the text output function for the text exchange may be activated.

Referring to FIG. 29A, a speakerphone function of the first device 1000may be activated, and a message exchange function via a chat window thatis displayed on a screen of the first device 1000 may be activated.

During the combination mode, the first device 1000 may also perform amessage exchange with the second device 2000 while the first device 1000performs the voice call with the second device 2000.

Referring to FIG. 29B, while a voice call function that does not involveusing a speakerphone function of the first device 1000 is activated, amessage exchange function via a chat window that is displayed on ascreen of the first device 1000 may be activated. The voice callfunction that does not involve using the speakerphone function mayindicate a voice call that is performed by using a speaker adjacent toan ear of a user and a microphone adjacent to a mouth of the user, whilethe first device 1000 is adjacent to a face of the user.

In this case, while the first device 1000 performs a voice input/outputwhen the voice call function is activated, the first device 1000 mayalso perform a text input/output via a chat window for exchanging amessage with the second device 2000.

Referring to FIG. 29C, while a user wears a wearable device 290 that isconnected with the first device 1000 in a wired or wireless manner, thefirst device 1000 may perform a voice-message call during a combinationmode. In this case, the first device 1000 may control the wearabledevice 290 to perform at least one of a voice input/output and a textinput/output for the voice-message call during the combination mode.

For example, when the wearable device 290 is a headphone, the firstdevice 1000 may control a voice from the first device 1000 to be outputvia the headphone while the first device 1000 performs the voice-messagecall during the combination mode.

For example, when the wearable device 290 is smart glasses, the firstdevice 1000 may control a chat window, which is output from the firstdevice 1000, to be output via the smart glasses while the first device1000 performs the voice-message call during the combination mode.

FIG. 30 illustrates an example where a call mode of the first device1000 that performs a voice-message call is switched from a voice mode toa combination mode or is switched from the combination mode to the voicemode, according to an exemplary embodiment.

Referring to FIG. 30, when a button 300 displayed on a screen of thefirst device 1000 that performs the voice-message call during the voicemode is selected, the call mode of the first device 1000 may be switchedfrom the voice mode to the combination mode. Also, when a button 301displayed on the screen of the first device 1000 that performs thevoice-message call during the combination mode is selected, the callmode of the first device 1000 may be switched from the combination modeto the voice mode.

FIG. 31 illustrates an example where a call mode of the first device1000 that performs a voice-message call is switched from a text mode toa combination mode or is switched from the combination mode to the textmode, according to an exemplary embodiment.

Referring to FIG. 31, when a button 310 displayed on a screen of thefirst device 1000 that performs the voice-message call during the textmode is selected, the call mode of the first device 1000 may be switchedfrom the text mode to the combination mode. Also, when a button 311displayed on the screen of the first device 1000 that performs thevoice-message call during the combination mode is selected, the callmode of the first device 1000 may be switched from the combination modeto the text mode.

FIG. 32 is a flowchart of a method of switching a mode of avoice-message call, the method performed by the first device 1000,according to an exemplary embodiment.

Because operation S3200 through S3220, and operation S3260 through S3290in the flowchart of FIG. 32 correspond to operation S2200 through S2220,and operation S2230 through S2260 of FIG. 22, descriptions aboutoperation S3200 through S3220, and operation S3260 through S3290 areomitted here.

As a result of determination in operation S3200, if a call mode is not avoice mode, in operation S3230, the first device 1000 may determinewhether the call mode of a voice-message call is a combination mode. Forexample, the first device 1000 may determine whether a button forswitching to the combination mode is selected by a first user, and thusmay determine whether the call mode is the combination mode.

As a result of determination in operation S3230, if it is determinedthat the call mode is the combination mode, in operation S3240, thefirst device 1000 may activate a speaker and a microphone in the firstdevice 1000.

In operation S3250, the first device 1000 may display a chat window on ascreen of the first device 1000. Also, the first device 1000 maydisplay, in the chat window, a text that is input by the first user viathe chat window. Also, the first device 1000 may display, in the chatwindow, a text that is converted from a voice of a second user and atext that is input to the second device 2000 by the second user.

As a result of the determination in operation S3230, if it is determinedthat the call mode is not the combination mode, the first device 1000may perform operation S3260.

FIG. 33 is a flowchart of a method of performing a voice-message callduring a combination mode, the method performed by the first device1000, according to an exemplary embodiment.

In operation S3300, the first device 1000 may determine that a call modeof the voice-message call is the combination mode. For example, thefirst device 1000 may determine whether a button for switching to thecombination mode is selected by a first user, and thus may determinethat the call mode is the combination mode.

When the call mode is the combination mode, in operation S3310, thefirst device 1000 may activate a speaker and a microphone, and inoperation S3320, the first device 1000 may display a chat window on ascreen of the first device 1000. Also, the first device 1000 maydisplay, in the chat window, a text that is input by the first user viathe chat window. Also, the first device 1000 may display, in the chatwindow, a text that is converted from a voice of a second user and atext that is input to the second device 2000 by the second user.

In operation S3330, the first device 1000 may receive a voice input bythe first user and/or a text input by the first user. The first device1000 may receive the voice input by the first user via an activatedmicrophone, and may receive the text input by the first user via adisplayed chat window. The first device 1000 may convert a voice that isinput by the first user into a text, or may convert a text that is inputby the first user into a voice.

In operation S3340, the first device 1000 may recognize a call mode ofthe second device 2000. The second device 2000 may transmit informationindicating the call mode of the second device 2000 to the first device1000, and the first device 1000 may recognize the call mode of thesecond device 2000, based on the information indicating the call modethat is received from the second device 2000.

In operation S3350, the first device 1000 may selectively transmit atleast one of the voice and the text of the first user to the seconddevice 2000. The first device 1000 may selectively transmit, to thesecond device 2000, at least one of the voice that is input by the firstuser, the text that is input by the first user, a text that is convertedfrom the voice input by the first user, and a voice that is convertedfrom the text input by the first user.

For one example, when the call mode of the second device 2000 is a voicemode, the first device 1000 may transmit, to the second device 2000, thevoice that is input by the first user, and the voice that is convertedfrom the text input by the first user. For another example, when thecall mode of the second device 2000 is a text mode, the first device1000 may transmit, to the second device 2000, the text that is input bythe first user, and the text that is converted from the voice input bythe first user. However, one or more exemplary embodiments are notlimited thereto.

FIG. 34 is a flowchart of a method of performing a voice-message callwith the second device 2000, the method performed by the first device1000 that operates in a combination mode, according to an exemplaryembodiment.

In operation S3400, the first device 1000 is call-connected with thesecond device 2000. The first device 1000 may transmit a request forcall-connection to the second device 2000 or may receive a request forcall-connection from the second device 2000, so that the first device1000 may be call-connected with the second device 2000.

In operation S3405, the first device 1000 may determine whether a callmode of the voice-message call is a combination mode. For example, thefirst device 1000 may determine whether a button for switching to thecombination mode is selected by a first user, and thus may determinewhether the call mode is the combination mode.

When the call mode is the combination mode, in operation S3410, thefirst device 1000 may activate a speaker and a microphone, and inoperation S3415, the first device 1000 may display a chat window on ascreen of the first device 1000.

In operation S3420, the first device 1000 may receive a voice input bythe first user. The first device 1000 may receive the voice input by thefirst user via the activated microphone.

In operation S3425, the first device 1000 may transmit the voice that isinput by the first user to the second device 2000, and in operationS3430, the first device 1000 may convert the voice that is input by thefirst user into a text. Also, the first device 1000 may display, in thechat window, the text that is converted from the voice input by thefirst user.

In operation S3435, the second device 2000 may transmit a voice of asecond user to the first device 1000, and in operation S3440, the firstdevice 1000 may output the voice of the second user. The first device1000 may output the voice of the second user via the activated speaker.

In operation S3445, the first device 1000 may convert the voice of thesecond user into a text. Also, the first device 1000 may display, in thechat window, the text that is converted from the voice of the seconduser.

In operation S3450, the first device 1000 may receive a text input bythe first user. The first device 1000 may receive the text input by thefirst user via the chat window, and may display the text input by thefirst user in the chat window.

In operation S3455, the first device 1000 may convert the text that isinput by the first user into a voice. For example, the first device 1000may determine a tone of the voice that is converted from the text inputby the first user, in consideration of a gender and an age of the firstuser. However, one or more exemplary embodiments are not limitedthereto, and the tone of the converted voice may be preset.

In operation S3460, the first device 1000 may transmit, to the seconddevice 2000, the voice that is converted from the text input by thefirst user.

FIG. 35A is a flowchart of a method of advising a first user of a changein a call mode of the second device 2000, and recommending a first userto change a call mode, the method performed by the first device 1000,according to an exemplary embodiment.

In operation S3500, the first device 100 may recognize a call mode ofthe second device 2000. The second device 2000 may transmit informationindicating the call mode of the second device 2000 to the first device1000, and the first device 1000 may recognize the call mode of thesecond device 2000, based on the information indicating the call modethat is received from the second device 2000.

In operation S3510, the first device 1000 may determine whether the callmode of the second device 2000 is changed. For example, the call mode ofthe second device 2000 may be changed from a voice mode to a text mode,may be changed from the voice mode to a combination mode, may be changedfrom the text mode to the voice mode, may be changed from the text modeto the combination mode, may be changed from the combination mode to thevoice mode, or may be changed from the combination mode to the textmode. Here, the first device 1000 may poll the second device 2000 forinformation of the mode. Alternatively, the second device 2000 mayinform the first device 1000 of a change in mode.

Also, the first device 1000 may determine whether an input method of thesecond device 2000 is changed. The first device 1000 may determinewhether the second device 2000 receives only a voice input, only a textinput, or a voice and text input for a voice-message call. Again, thefirst device may poll the second device for information about the inputmethod, or the second device 2000 may inform the first device about theinput method.

Also, the first device 1000 may determine whether an output method ofthe second device 2000 is changed. The first device 1000 may determinewhether the second device 2000 provides only a voice output, only a textoutput, or a voice and text output for the voice-message call. The firstdevice may poll the second device for information about the outputmethod, or the second device 2000 may inform the first device about theoutput method.

As a result of the determination in operation S3510, when the firstdevice 1000 determines that the call mode of the second device 2000 ischanged, in operation S3520, the first device 1000 may advise the firstuser of the changed call mode of the second device 2000. For oneexample, when a call mode of the first device 1000 is a voice mode, thefirst device 1000 may output a voice to advise the change in the callmode of the second device 2000. For another example, when the call modeof the first device 1000 is a text mode, the first device 1000 mayoutput, to a screen of the first device 1000, a text to advise thechange in the call mode of the second device 2000. For another example,when the call mode of the first device 1000 is a combination mode, thefirst device 1000 may output, to the screen of the first device 1000,the text to advise the change in the call mode of the second device 2000while the first device 1000 outputs the voice to advise the change inthe call mode of the second device 2000. However, one or more exemplaryembodiments are not limited thereto. Also, the first device 1000 mayadvise the first user of an output method during the changed call modeof the second device 2000.

Also, when the input method of the second device 2000 is changed, thefirst device 1000 may advise the first user of the changed input method.Also, when the output method of the second device 2000 is changed, thefirst device 1000 may advise the first user of the changed outputmethod.

In operation S3530, the first device 1000 may recommend a change in thecall mode of the first device 1000. For one example, while the firstdevice 1000 that operates in the voice mode performs a voice-messagecall with the second device 2000, when the call mode of the seconddevice 2000 is changed from the voice mode to the text mode, the firstdevice 1000 may recommend the first user to change the call mode of thefirst device 1000 from the voice mode to the text mode. In this case,the first device 1000 may output a voice “Do you want to change a callmode to a text mode ?” via a speaker, or message prompt. Also, when thefirst device 1000 changes the call mode from the voice mode to the textmode, the first device 1000 may provisionally cut a voice call channelestablished between the first device 1000 and the second device 2000.

For another example, while the first device 1000 that operates in thetext mode performs a voice-message call with the second device 2000,when the call mode of the second device 2000 is changed from the textmode to the voice mode, the first device 1000 may recommend the firstuser to change the call mode of the first device 1000 from the text modeto the voice mode. In this case, the first device 1000 may display atext “Do you want to change a call mode to a voice mode ?” in a chatwindow on a screen of the first device 1000, or output a voice prompt.When the first device 1000 changes the call mode from the text mode tothe voice mode, the first device 1000 may provisionally cut a channelfor a text exchange which is established between the first device 1000and the second device 2000.

For example, when the call mode of the second device 2000 is changed,the first device 1000 may generate a vibration and may simultaneouslydisplay a message indicating a mode change on the screen of the firstdevice 1000.

When the input method of the second device 2000 is changed, the firstdevice 1000 may recommend an input method of the first device 1000 toperform a voice-message call. Also, when the input method of the seconddevice 2000 is changed, the first device 1000 may recommend an outputmethod of the first device 1000 to perform the voice-message call.

Also, when the output method of the second device 2000 is changed, thefirst device 1000 may recommend an input method of the first device 1000to perform a voice-message call. Also, when the output method of thesecond device 2000 is changed, the first device 1000 may recommend anoutput method of the first device 1000 to perform the voice-messagecall.

FIG. 35B is a flowchart of a method of advising a first user of a changein input/output functions of the second device 2000 during a combinationmode, and recommending the first user to change a call mode, the methodperformed by the first device 1000, according to an exemplaryembodiment.

In operation S3540, the first device 1000 may recognize that theinput/output functions of the second device 2000 during the combinationmode are changed. The second device 2000 may transmit, to the firstdevice 1000, information indicating the change in the input/outputfunctions of the second device 2000 during the combination mode, and thefirst device 1000 may recognize the change in the input/output functionsof the second device 2000 during the combination mode, based on theinformation received from the second device 2000.

In operation S3550, the first device 1000 may determine whether theinput/output functions of the second device 2000 during the combinationmode are changed. For example, the first device 1000 may determinewhether at least one of a voice input function and a voice outputfunction for a voice call is changed or at least one of a text inputfunction and a text output function for a text exchange is changed inthe combination mode of the second device 2000.

Also, the first device 1000 may determine whether an input method of thesecond device 2000 is changed. The first device 1000 may determinewhether the second device 2000 receives only a voice input, only a textinput, or a voice and text input for a voice-message call.

Also, the first device 1000 may determine whether an output method ofthe second device 2000 is changed. The first device 1000 may determinewhether the second device 2000 provides only a voice output, only a textoutput, or a voice and text output for the voice-message call.

As a result of the determination in operation S3550, when the firstdevice 1000 determines that the input/output functions of the seconddevice 2000 during the combination mode are changed, in operation S3560,the first device 1000 may advise the first user of changed input/outputfunctions of the second device 2000. For example, the first device 1000may advise the first user of a changed output method of the seconddevice 2000. Also, when the input method of the second device 2000 ischanged, the first device 1000 may advise the first user of a changedinput method of the second device 2000. When the output method of thesecond device 2000 is changed, the first device 1000 may advise thefirst user of a changed output method of the second device 2000.

In operation S3570, the first device 1000 may recommend a change in thecall mode of the first device 1000. In this case, the first device 1000may recommend the first user of a call mode of the first device 1000,according to the change in the input/output functions of the seconddevice 2000 during the combination mode.

When the input method of the second device 2000 is changed, the firstdevice 1000 may recommend an input method of the first device 1000 toperform a voice-message call. Also, when the input method of the seconddevice 2000 is changed, the first device 1000 may recommend an outputmethod of the first device 1000 to perform the voice-message call.

Also, when the output method of the second device 2000 is changed, thefirst device 1000 may recommend an input method of the first device 1000to perform a voice-message call. Also, when the output method of thesecond device 2000 is changed, the first device 1000 may recommend anoutput method of the first device 1000 to perform the voice-messagecall.

FIG. 36 illustrates an example where the first device 1000 recommends afirst user to change a call mode from a voice mode to a text mode,according to an exemplary embodiment.

Referring to FIG. 36, the first device 1000 may perform a voice-messagecall while the first device 1000 operates during the voice mode, andthen when a call mode of the second device 2000 is changed from a voicemode to a text mode, the first device 1000 may output a voice “Call modeof the other side is changed from a voice mode to a text mode. Do youwant to change your call mode to a text mode?” via a speaker of thefirst device 1000.

Also, the first user may have the first device 1000 distant from a faceof the first user, and thus, the first device 1000 may change the callmode from the voice mode to the text mode.

FIG. 37 illustrates an example where the first device 1000 recommends afirst user to change a call mode from a text mode to a voice mode,according to an exemplary embodiment.

Referring to FIG. 37, the first device 1000 may perform a voice-messagecall while the first device 1000 operates during the text mode, and thenwhen a call mode of the second device 2000 is changed from a text modeto a voice mode, the first device 1000 may output a voice “Call mode ofthe other side is changed from a text mode to a voice mode. Do you wantto change your call mode to a voice mode?” via a speaker of the firstdevice 1000.

Also, the first user may make the first device 1000 adjacent to a faceof the first user, and thus the first device 1000 may change the callmode from the text mode to the voice mode.

FIG. 38 is a flowchart of a method of generating a call list in relationto voice-message calls, the method performed by the first device 1000,according to an exemplary embodiment.

In operation S3800, the first device 1000 may obtain device informationabout the second device 2000 that performs a voice-message call with thefirst device 1000. For example, the first device 1000 may obtaininformation about a Service Set Identifier (SSID) of the second device2000, a telephone number of the second device 2000, a name of a seconduser of the second device 2000, and a type of the second device 2000.

In operation S3810, the first device 1000 may obtain information about atime in relation to a call with the second device 2000. For example, thefirst device 1000 may obtain information about a time when the firstdevice 1000 and the second device 2000 initiate the voice-message call,a time when the first device 1000 and the second device 2000 end thevoice-message call, and a time period during which the first device 1000and the second device 2000 perform the voice-message call.

In operation S3820, the first device 1000 may obtain information about acall location of the first device 1000. The first device 1000 may obtaininformation about a location of the first device 1000 while the firstdevice 1000 and the second device 2000 perform the voice-message call.

In operation S3830, the first device 1000 may back up text informationabout a text in a chat window generated during the voice-message call.The first device 1000 may back up the text in the chat window whichindicates a conversation between the first user and the second user. Thetext may be backed up in the device 1000 or a server that mediatesconnection between the device 1000 and the device 2000.

Also, the first device 1000 may back up a text that is obtained for apreset time period before a predetermined event occurs. For example, thepredetermined event may include an end of a call between the firstdevice 1000 and the second device 2000, reception of a user input for atext backup, or the like. For example, when the call between the firstdevice 1000 and the second device 2000 ends, the first device 1000 mayback up a text that is obtained by the first device 1000 for fiveminutes before the call ends. For example, when the first device 1000receives the user input for the text backup, the first device 1000 mayback up a text that is obtained by the first device 1000 for threeminutes before the user input is received. However, a type of the eventand a time value that are set for the text backup are not limitedthereto.

Also, the first device 1000 may back up a part of the text indicatingthe conversation between the first user and the second user in the firstdevice 1000, and may back up all of the text indicating the conversationbetween the first user and the second user in the server 3000.

In operation S3840, the first device 1000 may generate the call list,based on a plurality of pieces of the information obtained in operationsS3800 through S3820.

In operation S3850, the first device 1000 may associate the generatedcall list with the text information that is backed up in operation S3830and may store the call list. Because the call list is associated withthe backed up text information and then is stored, the first device 1000may provide the first user with conversation content that corresponds tothe call list, according to a user input in relation to the call list.In this case, when a first button is selected from the call list, thefirst device 1000 may first display a part of the conversation contentthat corresponds to the call list on a screen of the first device 1000,and when a second button is selected in the screen on which the part ofthe conversation content is displayed, the first device 1000 may displayall of the conversation content that corresponds to the call list on thescreen of the first device 1000.

FIG. 39 is a flowchart of a method of displaying a text indicating aconversation between a first user and a second user via a call list ofthe first device 1000, according to an exemplary embodiment.

In operation S3900, the first device 1000 may select the second device2000 from the call list of the first device 1000. The first device 1000may select a telephone number of the second device 2000 or a name of thesecond user from the call list, based on a user input.

In operation S3910, according to selection of the second device 2000,the first device 1000 may display the text indicating the conversationbetween the first user and the second user on a screen of the firstdevice 1000.

FIGS. 40 through 42 illustrate examples of a call list, according toexemplary embodiments.

Referring to FIG. 40, telephone numbers of a plurality of the seconddevices 2000 may be displayed in the call list that is displayed in ascreen of the first device 1000. Also, in order to see conversationcontent related to a specific call, a first user may select a button 350in the call list. In this regard, a user may view a history of theconversation with another user.

When the first user selects the button 350, a text indicatingconversation content that corresponds to the selected button 350 may bedisplayed on an entire portion of the screen of the first device 1000,as illustrated in FIG. 41. In this case, the text that indicates theconversation content may correspond to a part of the conversationcontent. Also, the text that indicates the part of the conversationcontent may be stored in the first device 1000, but one or moreexemplary embodiments are not limited thereto.

Also, referring to FIG. 41, a button 410 for showing all of theconversation content may be displayed in a window that includes the textthat indicates the part of the conversation content. When the first userpresses the button 410, the first device 1000 may display a textindicating all of the conversation content on the screen of the firstdevice 1000. In this case, the text indicating all of the conversationcontent may be stored in the server 3000, and the first device 1000 mayreceive the text indicating all of the conversation content from theserver 3000 and may display the text.

When the first user selects the button 350, a pop-up window thatincludes a text indicating conversation content corresponding to theselected button 350 may be displayed on a portion of the screen of thefirst device 1000, as shown in FIG. 42.

When the first user selects the button 350, all of the conversationcontent that corresponds to the selected button 350 may be displayed,but one or more exemplary embodiments are not limited thereto.

FIG. 43 illustrates an example where the first device 1000 and thesecond device 2000 perform a voice-message call via the server 3000,according to an exemplary embodiment.

Referring to FIG. 43, the first device 1000 may perform thevoice-message call with the second device 2000 via the server 3000.Also, the server 3000 may perform a TTS function and an STT function forthe voice-message call.

For example, the server 3000 may convert a first user's voice that isinput via the first device 1000 into a text, and a first user's textthat is input via the first device 1000 into a voice. Also, the server3000 may convert a second user's voice that is input via the seconddevice 2000 into a text, and a second user's text that is input via thesecond device 2000 into a voice.

FIG. 44 is a flowchart of a method of supporting a voice-message callbetween the first device 1000 and the second device 2000 by convertingvoices of first and second users into texts, the method performed by theserver 3000, according to an exemplary embodiment.

In operation S4400, the first device 1000 and the second device 2000 arecall-connected with each other. The first device 1000 may becall-connected with the second device 2000 by transmitting a request forcall-connection to the second device 2000, or by receiving a request forcall-connection from the second device 2000.

In operation S4405, the first device 1000 may activate a voice-messagecall function. The first device 1000 may activate the voice-message callfunction, based on a user input. In operation S4405, the first device1000 activates the voice-message call function after the first device1000 is call-connected with the second device 2000. However, one or moreexemplary embodiments are not limited thereto. For example, the firstdevice 1000 may activate the voice-message call function when the firstdevice 1000 sends a call or receives a call, or while the first device1000 performs a call.

In operation S4410, the second device 2000 may activate a voice-messagecall function. The second device 2000 may activate the voice-messagecall function, based on a user input. In operation S4410, the seconddevice 2000 activates the voice-message call function after the seconddevice 2000 is call-connected with the first device 1000. However, oneor more exemplary embodiments are not limited thereto. For example, thesecond device 2000 may activate the voice-message call function when thesecond device 2000 sends a call or receives a call, or while the seconddevice 2000 performs a call.

In operation S4415, the first device 1000 may transmit a voice of thefirst user to the server 3000. The first device 1000 may obtain thevoice of the first user via a microphone in the first device 1000, andmay transmit the obtained voice to the server 3000.

In operation S4420, the server 3000 may transmit the voice of the firstuser to the second device 2000.

In operation S4425, the server 3000 may convert the voice of the firstuser into a text. The server 3000 may convert the voice of the firstuser into the text by using various STT techniques.

In operation S4430, the server 3000 may transmit the text that isconverted from the voice of the first user to the second device 2000,and in operation S4435, the server 3000 may transmit the text that isconverted from the voice of the first user to the first device 1000.

In operation S4440, the second device 2000 may transmit the voice of thesecond user to the server 3000. The second device 2000 may obtain thevoice of the second user via a microphone in the second device 2000 andmay transmit the obtained voice to the server 3000.

In operation S4445, the server 3000 may transmit the voice of the seconduser to the first device 1000.

In operation S4450, the server 3000 may convert the voice of the seconduser into a text. The server 3000 may convert the voice of the seconduser into the text by using the various STT techniques.

In operation S4455, the server 3000 may transmit the text that isconverted from the voice of the second user to the first device 1000,and in operation S4460, the server 3000 may transmit the text that isconverted from the voice of the second user to the second device 2000.

In operation S4465, the first device 1000 may arrange the received textsin a temporal order. For one example, according to a time when the voiceof the first user is input to the first device 1000 and a time when thevoice of the second user is received, the first device 1000 may arrangethe text that is converted from the voice of the first user and the textthat is converted from the voice of the second user. For anotherexample, according to the time when the voice of the first user is inputto the first device 1000 and a time when the voice of the second user isinput to the second device 2000, the first device 1000 may arrange thetext that is converted from the voice of the first user and the textthat is converted from the voice of the second user. However, one ormore exemplary embodiments are not limited thereto.

In operation S4470, the first device 1000 may display a chat windowincluding the arranged texts on a screen of the first device 1000. Thefirst device 1000 may display the chat window on the screen of the firstdevice 1000 while the first device 1000 performs the voice-message call.Also, the first device 1000 may display the chat window on the screen ofthe first device 1000 or may hide the chat window in the screen of thefirst device 1000, depending on a call mode of the voice-message call.

In operation S4475, the second device 2000 may arrange the receivedtexts in a temporal order. For one example, according to a time when thevoice of the second user is input to the second device 2000 and a timewhen the voice of the first user is received, the second device 2000 mayarrange the text that is converted from the voice of the first user andthe text that is converted from the voice of the second user. Foranother example, according to the time when the voice of the second useris input to the second device 2000 and a time when the voice of thefirst user is input to the second device 2000, the second device 2000may arrange the text that is converted from the voice of the first userand the text that is converted from the voice of the second user.However, one or more exemplary embodiments are not limited thereto.

In operation S4480, the second device 2000 may display a chat windowincluding the arranged texts on a screen of the second device 2000. Thesecond device 2000 may display the chat window on the screen of thesecond device 2000 while the second device 2000 performs thevoice-message call. Also, the second device 2000 may display the chatwindow on the screen of the second device 2000 or may hide the chatwindow in the screen of the second device 2000, depending on a call modeof the voice-message call.

As discussed above, the server 3000 may mediate the connection betweenthe first device 1000 and the second device 2000. Accordingly, theserver 3000 may perform conversion between text and voice as necessary.Further, the server may perform storage functions, thereby storing textand voice data as necessary.

FIG. 45 is a flowchart of a method of supporting a voice-message callbetween the first device 1000 and the second device 2000 by convertingtexts of first and second users into voices, the method performed by theserver 3000, according to an exemplary embodiment.

Because operations S4500 through S4510 of FIG. 45 correspond tooperations S4400 through S4410 of FIG. 44, descriptions thereof areomitted here.

In operation S4515, the first device 1000 may transmit the text that isinput by the first user to the server 3000, and in operation S4520, theserver 3000 may transmit the text that is input by the first user to thesecond device 2000.

In operation S4525, the server 3000 may convert the text that is inputby the first user into a voice. The server 3000 may determine a tone ofthe voice that is converted from the text of the first user, inconsideration of user information (e.g., a gender and an age) about thefirst user.

In operation S4530, the server 3000 may transmit, to the second device2000, the voice that is converted from the text of the first user, andin operation S4535, the server 3000 may transmit, to the first device1000, the voice that is converted from the text of the first user.

In operation S4540, the second device 2000 may transmit the text that isinput by the second user to the server 3000, and in operation S4545, theserver 3000 may transmit the text that is input by the second user tothe first device 1000.

In operation S4550, the server 3000 may convert the text that is inputby the second user into a voice. The server 3000 may determine a tone ofthe voice that is converted from the text of the second user, inconsideration of user information (e.g., a gender and an age) about thesecond user.

In operation S4555, the server 3000 may transmit, to the first device1000, the voice that is converted from the text of the second user, andin operation S4560, the server 3000 may transmit, to the second device2000, the voice that is converted from the text of the second user.

In operation S4565, the first device 1000 may display a chat window thatshows a conversation between the first user and the second user,depending on a status of the first device 1000. For example, when a callmode of the first device 1000 is a text mode or a combination mode, thefirst device 1000 may display the chat window that shows theconversation between the first user and the second user on the screen ofthe first device 1000.

In operation S4570, the first device 1000 may output the voice of thesecond user, depending on a status of the first device 1000. Forexample, when the call mode of the first device 1000 is a voice mode orthe combination mode, the first device 1000 may output the voice of thesecond user.

In operation S4575, the second device 2000 may display a chat windowthat shows a conversation between the first user and the second user,depending on a status of the second device 2000. For example, when acall mode of the second device 2000 is a text mode or a combinationmode, the second device 2000 may display the chat window that shows theconversation between the first user and the second user on the screen ofthe second device 2000.

In operation S4580, the second device 2000 may output the voice of thefirst user, depending on a status of the second device 2000. Forexample, when a call mode of the second device 2000 is a voice mode orthe combination mode, the second device 2000 may output the voice of thefirst user.

As discussed above, the server 3000 may mediate the connection betweenthe first device 1000 and the second device 2000. Accordingly, theserver 3000 may perform conversion between text and voice as necessary.Further, the server may perform storage functions, thereby storing textand voice data as necessary.

FIG. 46 is a flowchart of a method of storing voice data and text datarelated to a voice-message call between the first device 1000 and thesecond device 2000, the method performed by the server 3000, accordingto an exemplary embodiment.

In operation S4600, the first device 1000 may perform the voice-messagecall with the second device 2000. The first device 1000 and the seconddevice 2000 may perform the voice-message call via the server 3000, butone or more exemplary embodiments are not limited thereto. The firstdevice 1000 may directly perform the voice-message call with the seconddevice 2000.

In operation S4610, the first device 1000 may store a text thatindicates a part of a conversation between users. The first device 1000may obtain a text that is converted from a voice that a first userinputs to the first device 1000, a text that is converted from a voicethat a second user inputs to the second device 2000, a text that thefirst user inputs to the first device 1000, and a text that the seconduser inputs to the second device 2000.

Also, the first device 1000 may obtain a text indicating theconversation between users from at least one of the first device 1000,the second device 2000, and the server 3000. Also, the first device 1000may store a part of the obtained text in the first device 1000.

In operation S4620, the first device 1000 may transmit a text indicatingall of the conversation between users to the server 3000, and inoperation S4630, the server 3000 may store the text indicating all ofthe conversation between users. In operations S4620 and S4630, theserver 3000 receives the text indicating all of the conversation betweenusers from the first device 1000 and stores the conversation, but one ormore exemplary embodiments are not limited thereto. The server 3000 mayreceive the text indicating a part of the conversation between usersfrom the first device 1000, may receive a text indicating a part of theconversation between users from the second device 2000, and may directlygenerate a text indicating a part of the conversation between users.Also, the server 3000 may obtain the text indicating all of theconversation between users by combining the text received from the firstdevice 1000, the text received from the second device 2000, and the textgenerated by the server 3000.

In operation S4640, the first device 1000 may store voice data thatindicates the text indicating the part of the conversation betweenusers. The first device 1000 may obtain voice data that is convertedfrom a text that the first user inputs to the first device 1000, voicedata that is converted from a text that the second user inputs to thesecond device 2000, voice data that the first user inputs to the firstdevice 1000, and voice data that the second user inputs to the seconddevice 2000.

Also, the first device 1000 may obtain voice data that indicates theconversation between users from at least one of the first device 1000,the second device 2000, and the server 3000. Also, the first device 1000may store a part of the obtained voice data in the first device 1000.

In operation S4650, the first device 1000 may transmit voice dataindicating all of the conversation between users to the server 3000, andin operation S4660, the server 3000 may store the voice data indicatingall of the conversation between users. In operation S4650 and S4660, theserver 3000 receives the voice data indicating all of the conversationbetween users from the first device 1000 and stores it, but one or moreexemplary embodiments are not limited thereto. The server 3000 mayreceive voice data indicating a part of the conversation between usersfrom the first device 1000, may receive voice data indicating a part ofthe conversation between users from the second device 2000, and maydirectly generate voice data indicating a part of the conversationbetween users. Also, the server 3000 may obtain the voice dataindicating all of the conversation between users by combining the voicedata received from the first device 1000, the voice data received fromthe second device 2000, and the voice data generated by the server 3000.

FIG. 47 illustrates in example where the first device 1000, the seconddevice 2000, and a third device 4000 perform a voice-message call witheach other, according to an exemplary embodiment.

Referring to FIG. 47, the voice-message call may be performed among thefirst device 1000, the second device 2000, and the third device 4000.For example, while the first device 1000 and the second device 2000perform a voice-message call, the third device 4000 may participate inthe voice-message call that the first device 1000 and the second device2000 perform. Alternatively, for example, the first device 1000, thesecond device 2000, and the third device 4000 may initiate avoice-message call together. Although three devices are illustrated, anynumber of devices may participate in a voice-message call.

When the voice-message call is performed among the first device 1000,the second device 2000, and the third device 4000, i) one or moreoperations between the first device 1000 and the second device 2000 toperform the voice-message call, ii) one or more operations between thefirst device 1000 and the third device 4000 to perform the voice-messagecall, and iii) one or more operations between the second device 2000 andthe third device 4000 to perform the voice-message call may correspondto the operations that are illustrated and described with reference toFIGS. 1 through 42.

FIG. 48 illustrates an example where the first device 1000, the seconddevice 2000, and the third device 4000 perform a voice-message call witheach other via the server 3000, according to an exemplary embodiment.

Referring to FIG. 48, when the first device 1000, the second device2000, and the third device 4000 perform the voice-message call with eachother via the server 3000, a voice that is input to the first device1000, a voice that is input to the second device 2000, and a voice thatis input to the third device 4000 may be completely or partly convertedinto texts by the server 3000. Also, a text that is input to the firstdevice 1000, a text that is input to the second device 2000, and a textthat is input to the third device 4000 may be completely or partlyconverted into voices by the server 3000.

Also, when the first device 1000, the second device 2000, and the thirddevice 4000 perform the voice-message call with each other via theserver 3000, i) one or more operations between the first device 1000,the second device 2000, and the server 3000 to perform the voice-messagecall, ii) one or more operations between the first device 1000, thethird device 4000, and the server 3000 to perform the voice-messagecall, and iii) one or more operations between the second device 2000,the third device 4000, and the server 3000 to perform the voice-messagecall may correspond to the operations that are illustrated and describedwith reference to FIGS. 43 through 46.

FIGS. 49 and 50 are block diagrams of the first device 1000, accordingto embodiments of the present invention.

As illustrated in FIG. 49, the first device 1000 may include a userinput unit 1100, an output unit 1200, a control unit 1300, and acommunication unit 1500. However, the first device 1000 may be embodiedwith more or less elements than the elements shown in FIG. 49.

For example, as illustrated in FIG. 50, the first device 1000 mayfurther include a sensing unit 1400, an audio/video (A/V) input unit1600, and a memory 1700 in addition to the user input unit 1100, theoutput unit 1200, the control unit 1300, and the communication unit1500.

The user input unit 1100 may be a unit by which a user inputs data tocontrol the first device 1000. For example, the user input unit 1100 mayinclude a key pad, a dome switch, a touch pad (a touch capacitive typetouch pad, a pressure resistive type touch pad, an infrared beam sensingtype touch pad, a surface acoustic wave type touch pad, an integralstrain gauge type touch pad, a piezo effect type touch pad, or thelike), a jog wheel, and a jog switch, but one or more exemplaryembodiments are not limited thereto.

The user input unit 1100 may receive a user input for a voice-messagecall. For example, the user input unit 1100 may receive a user's voiceinput, a user's text input, and a user's touch input.

The output unit 1200 may function to output an audio signal, a videosignal, or a vibration signal and may include a display unit 1210, asound output unit 1220, a vibration motor 1230, or the like.

The display unit 1210 may display and output information that isprocessed in the first device 1000. For example, the display unit 1210may display a chat window that includes a text indicating a conversationbetween users during the voice-message call.

When the display unit 1210 and a touch pad form a mutual layer structureand then are formed as a touch screen, the display unit 1210 may be usedas both an output device and input device. The display unit 1210 mayinclude at least one of a liquid crystal display (LCD), a thin filmtransistor-liquid crystal display (TFT-LCD), an organic light-emittingdiode display, a flexible display, a three-dimensional (3D) display, andan electrophoretic display. Also, according to a type of the firstdevice 1000, the first device 1000 may include at least two displayunits 1210. Here, the at least two display units 1210 may face eachother by using a hinge.

The sound output unit 1220 may output audio data that is received fromthe communication unit 1500 or is stored in the memory 1700. Also, thesound output unit 1220 outputs a sound signal (e.g., a call signalreceiving sound, a message receiving sound, an alarm sound, or the like)related to capabilities performed by the first device 1000. The soundoutput unit 1220 may include a speaker, a buzzer, or the like.

The vibration motor 1230 may output a vibration signal. For example, thevibration motor 1230 may output the vibration signal that corresponds toan output of the audio data (e.g., the call signal receiving sound, themessage receiving sound, or the like) or video data. Also, when a touchis input via a touch screen, the vibration motor 1230 may output avibration signal.

The control unit 1300 may generally control all operations of the firstdevice 1000. For example, the control unit 1300 may control the userinput unit 1100, the output unit 1200, the sensing unit 1400, thecommunication unit 1500, the A/V input unit 1600, etc. by executingprograms stored in the memory 1700. The control unit 1300 may generallycontrol the user input unit 1100, the output unit 1200, the sensing unit1400, the communication unit 1500, the A/V input unit 1600, etc. toperform operations of the first device 1000 in FIGS. 1 through 49.

In more detail, the control unit 1300 may activate a voice-message callfunction. When the first device 1000 sends a call to the second device2000, the control unit 1300 may activate the voice-message callfunction. Alternatively, when the first device 1000 receives a call fromthe second device 2000, the control unit 1300 may activate thevoice-message call function. Alternatively, while the first device 1000performs a call with the second device 2000, the control unit 1300 mayactivate the voice-message call function.

Also, when the voice-message call function is activated, the controlunit 1300 may advise the second device 2000 that the voice-message callfunction is activated in the first device 1000. In this case, thecontrol unit 1300 may advise the second device 2000 of a call mode ofthe voice-message call of the first device 1000.

The control unit 1300 may obtain texts that are converted from a voiceof a user of the first device 1000 and a voice of a user of the seconddevice 2000. The control unit 1300 may convert the voice of the user ofthe first device 1000 into a text and thus may obtain the convertedtext. Also, the control unit 1300 may receive the voice of the user ofthe second device 2000 from the second device 2000 via the communicationunit 1500, may convert the voice into a text, and thus may obtain theconverted text. However, a method of obtaining the converted text, themethod performed by the first device 1000, is not limited thereto. Thevoice of the user of the first device 1000 and the voice of the user ofthe second device 2000 may be converted into texts by various devices ora server, and the first device 1000 may receive the converted texts fromthe various devices and the server via the communication unit 1500.

The control unit 1300 may obtain a text that is input by a user. Thecontrol unit 1300 may obtain a text that is input by the user of thefirst device 1000 during a voice-message call. Also, during thevoice-message call, the control unit 1300 may receive, from the seconddevice 2000, a text that is input to the second device 2000 by the userof the second device 2000.

The control unit 1300 may arrange the converted texts and the inputtexts in a temporal order and may display the converted texts and theinput texts on a screen of the first device 1000 during a call betweenthe users. The control unit 1300 may arrange the converted texts and theinput texts in the temporal order, based on input times of the voicesand the texts. For example, based on a time when the user of the firstdevice 1000 inputs the voice into the first device 1000, a time when theuser of the second device 2000 inputs the voice into the second device2000, a time when the user of the first device 1000 inputs the text intothe first device 1000, and a time when the user of the second device2000 inputs the text into the second device 2000, the control unit 1300may arrange the converted texts and the input texts.

The control unit 1300 may back up original voice data of the convertedtexts in the memory 1700 or the server 3000. The control unit 1300 mayback up voice data of the first user that corresponds to the text thatis converted from the voice of the first user. Also, the control unit1300 may back up voice data of the second user that corresponds to thetext that is converted from the voice of the second user.

The control unit 1300 may display a chat window on the screen of thefirst device 1000 during a call between the first user and the seconduser. The control unit 1300 may display the chat window on the screen ofthe first device 1000 to show contents of a conversation between thefirst user and the second user.

The control unit 1300 may obtain a text that is input by the first uservia the chat window. Also, the control unit 1300 may receive, from thesecond device 2000, a text that the second user inputs to the seconddevice 2000 during the voice-message call.

The control unit 1300 may arrange the converted texts and the inputtexts in a temporal order and may display the converted texts in thechat window. The control unit 1300 may arrange the converted texts andthe input texts in the temporal order, based on input times of thevoices and the texts. For example, the control unit 1300 may arrange theconverted texts and the input texts, based on a time when the first userinputs the voice into the first device 1000, a time when the second userinputs the voice into the second device 2000, a time when the first userinputs the text into the first device 1000, and a time when the seconduser inputs the text into the second device 2000.

The control unit 1300 may distinguish between the converted texts andthe input texts and may display them. The control unit 1300 maydistinguish the text converted from the voice of the first user and thetext converted from the voice of the second user from the text input bythe first user and the text input by the second user, and may displaythem.

In order to distinctively display the converted texts, the control unit1300 may display a separate icon around the converted texts.Alternatively, the control unit 1300 may distinctively display a color,a thickness, or a font of the converted texts. However, one or moreexemplary embodiments are not limited thereto.

When at least one converted text among the converted texts is selected,the control unit 1300 may output original voice data of the selectedconverted text. When the converted text is selected in the chat windowby the first user, the control unit 1300 may extract the original voicedata of the selected converted text from a memory, and may output theextracted original voice data via a speaker in the first device 1000.

The control unit 1300 may back up a text among the arranged texts,wherein the text is obtained for a preset time period before apredetermined event occurs. For example, the predetermined event mayinclude an end of a call between the first device 1000 and the seconddevice 2000, reception of a user input for a text backup, or the like.For one example, when the call between the first device 1000 and thesecond device 2000 ends, the first device 1000 may back up a text thatis obtained by the first device 1000 for five minutes before the callends. For another example, when the first device 1000 receives the userinput for the text backup, the control unit 1300 may back up a text thatis obtained by the first device 1000 for three minutes before the userinput is received. However, a type of the event and a time value thatare set for the text backup are not limited thereto.

The control unit 1300 may back up all of the arranged texts in theserver 3000. In this case, the control unit 1300 may back up some of thearranged texts in the first device 1000 and may back up all of thearranged texts in the server 3000. Alternatively, the first device 1000may back up some of the arranged texts and all of the arranged texts inthe server 3000.

The control unit 1300 may analyze a conversation between the users byperforming various natural language-based analyzing methods on all ofthe arranged texts, and may extract a part from the arranged texts whichindicates important contents of the conversation between the users.Also, the control unit 1300 may back up a text indicating the extractedpart of the conversation in the first device 1000.

The control unit 1300 may activate a voice-message call function and maydetermine a chat application to be used during a voice-message call. Forone example, the control unit 1300 may determine a chat application thatis executable by interoperating with the voice-message call function ofthe first device 1000, as the chat application to be used during thevoice-message call. For another example, the control unit 1300 maydetermine a chat application that is installed in all of the firstdevice 1000 and the second device 2000, as the chat application to beused during the voice-message call. However, one or more exemplaryembodiments are not limited thereto.

The control unit 1300 may execute the determined chat application, andmay input a text, which is converted from a voice, into the executedchat application. For example, the control unit 1300 may install aplug-in for a text automatic input in the executed chat application, andmay input the text converted from the voice into the chat applicationvia the installed plug-in. However, one or more exemplary embodimentsare not limited thereto.

The control unit 1300 may display a chat window on the screen of thefirst device 1000 during a call between users. The control unit 1300 mayarrange, in the chat window, a text that is converted from a voice ofthe first user, a text that is input to the first device 1000 by thefirst user, a text that is converted from a voice of the second user,and a text that is input to the second device 2000 by the second user.

Also, the control unit 1300 may display the chat window on the screen ofthe first device 1000 or may hide the chat window in the screen of thefirst device 1000, depending on a call mode of the voice-message call ofthe first device 1000.

The control unit 1300 may initiate a voice-message call while the firstdevice 1000 and the second device 2000 use a chat service.

The control unit 1300 may recognize that a call mode of the first device1000 is changed during the voice-message call. The call mode may includea voice mode, a text mode, and a combination mode. When the call mode ischanged, the control unit 1300 may activate or inactivate at least oneof the speaker and a microphone of the first device 1000. Also, when thecall mode is changed, the control unit 1300 may display or hide the chatwindow used in the voice-message call on the screen of the first device1000. Also, the control unit 1300 may selectively provide a voice or atext of a user to the second device 2000, depending on a call mode ofthe second device 2000.

The control unit 1300 may advise the first user of a change in the callmode of the second device 2000, and may recommend the first user tochange the call mode of the first device 1000. Also, the control unit1300 may advise the first user of a change in input/output functions ofthe second device 2000 during a combination mode, and may recommend thefirst user to change the call mode of the first device 1000.

The control unit 1300 may back up a part or all of text informationabout a text in the chat window in the first device 1000 or the server3000. The control unit 1300 may associate the text information in thechat window with a call list and may store the call list.

The sensing unit 1400 may sense the status of the first device 1000 or astatus of surroundings around the first device 1000, and may deliverinformation about the sensed statuses to the control unit 1300.

The sensing unit 1400 may include at least one of a magnetic sensor1410, an acceleration sensor 1420, a temperature/humidity sensor 1430,an infrared sensor 1440, a gyroscope sensor 1450, a position sensor(e.g., GPS) 1460, an air pressure sensor 1470, a proximity sensor 1480,and an RGB sensor (i.e., a luminance sensor) 1490, but one or moreembodiments of the present invention are not limited thereto. Functionsof the sensors may be intuitionally deduced by one of ordinary skill inthe art by referring to names of the sensors, thus, detaileddescriptions thereof are omitted here.

The communication unit 1500 may include one or more elements allowingthe first device 1000 to perform communication at least one of thesecond device 2000, the third device 4000, and the server 3000. Forexample, the communication unit 1500 may include a short-rangecommunication unit 1510, a mobile communication unit 1520, and abroadcast receiving unit 1530.

The short-range communication unit 1510 may include, but is not limitedthereto, a Bluetooth communication unit, a BLE communication unit, anNFC/RFID unit, a Wi-Fi communication unit, a ZigBee communication unit,an IrDA communication unit, a WFD communication unit, a UWBcommunication unit, an Ant+ communication unit, or the like.

The mobile communication unit 1520 transmits and receives a wirelesssignal with at least one of a base station, an external terminal, and aserver on a mobile communication network. The wireless signal mayinclude various types of data according to communication of a sound callsignal, a video call signal, or a text/multimedia message.

The broadcast receiving unit 1530 receives a broadcast signal and/orinformation related to broadcast from the outside through a broadcastchannel. The broadcast channel may include a satellite channel and aground wave channel. According to an embodiment, the first device 1000may not include the broadcast receiving unit 1530.

The communication unit 1500 may allow the first device 1000 to exchangeinformation for a voice-message call with at least one of the seconddevice 2000, the third device 4000, and the server 3000.

The A/V input unit 1600 may receive an input of an audio signal or avideo signal and may include a camera 1610 and a microphone 1620. Thecamera 1610 may obtain an image frame such as a still image or a movingpicture via an image sensor during a video call mode or animage-capturing mode. An image that is captured via the image sensor maybe processed by the control unit 1300 or a separate image processingunit (not shown).

The image frame that is processed by the camera 1610 may be stored inthe memory 1700 or may be transmitted to an external source via thecommunication unit 1500. According to configuration of the first device1000, two or more cameras 1610 may be arranged.

The microphone 1620 receives an external sound signal as an input andprocesses the received sound signal into electrical voice data. Forexample, the microphone 1620 may receive a sound signal from an externaldevice or a speaker. In order to remove noise that occurs while thesound signal is externally input, the microphone 1620 may use variousnoise removing algorithms.

The memory 1700 may store a program for processing and controlling thecontrol unit 1300, or may store a plurality of pieces of data that areinput to the first device 1000 or output from the first device 1000.

The memory 1700 may include a storage medium of at least one type of aflash memory, a hard disk, a multimedia card type memory, a card typememory such as an SD or XD card memory, a random access memory (RAM), astatic random access memory (SRAM), a read-only memory (ROM), anelectrically erasable programmable read-only memory (EEPROM), aprogrammable read-only memory (PROM), a magnetic memory, a magneticdisc, and an optical disc.

The programs stored in the memory 1700 may be classified into aplurality of modules according to their functions, for example, into auser interface (UI) module 1710, a touch screen module 1720, an alarmmodule 1730, etc.

The UI module 1710 may provide a specialized UI or a graphical userinterface (GUI) in connection with the first device 1000 for eachapplication. The touch screen module 1720 may detect a user's touchgesture on a touch screen and transmit information related to the touchgesture to the control unit 1300. The touch screen module 1720 mayrecognize and analyze a touch code. The touch screen module 1720 may beconfigured by additional hardware including a controller.

Various sensors may be arranged in or near the touch screen to detect atouch or a proximate touch on the touch sensor. An example of the sensorto detect the touch on the touch screen may include a tactile sensor.The tactile sensor detects a contact of a specific object at least assensitively as a person can detect. The tactile sensor may detectvarious types of information such as the roughness of a contact surface,the hardness of the contact object, the temperature of a contact point,or the like.

An example of the sensor to detect the touch on the touch screen mayinclude a proximity sensor.

The proximity sensor detects the existence of an object that approachesa predetermined detection surface or that exists nearby, by using aforce of an electro-magnetic field or an infrared ray, instead of amechanical contact. Examples of the proximity sensor include atransmission-type photoelectric sensor, a direction reflection-typephotoelectric sensor, a mirror reflection-type photoelectric sensor, ahigh frequency oscillation-type proximity sensor, a capacity-typeproximity sensor, a magnetic proximity sensor, an infrared-typeproximity sensor, or the like. The touch gesture (i.e., an input) of theuser may include a tap gesture, a touch & hold gesture, a double tapgesture, a drag gesture, a panning gesture, a flick gesture, a drag &drop gesture, a swipe gesture, or the like.

The alarm module 1730 may generate a signal for alarming occurrence ofan event. Examples of the event that occurs in the first device 1000 mayinclude a call signal reception, a message reception, a key signalinput, schedule notification, or the like. The alarm module 1730 mayoutput a video-format alarm signal via the display unit 1210, may outputan audio-format alarm signal via the sound output unit 1220, or avibration signal via the vibration motor 1230.

FIG. 51 is a block diagram of the server 3000, according to an exemplaryembodiment.

Referring to FIG. 51, the server 3000 may include a communication unit3100, a control unit 3200, and a database (DB) 3300. The DB 3300 mayinclude a voice DB 3310, a text DB 3320, and a call list DB 3330.

The communication unit 3100 may transmit data that is required toperform a voice-message call between at least two of the first device1000, the second device 2000, and the third device 4000, to at least twoof the first device 1000, the second device 2000, and the third device4000.

The control unit 3200 may generally control all operations of the server3000. For example, the control unit 3200 may control all operations ofthe server 3000, by executing programs stored in the DB 3300.

In more detail, the control unit 3200 may convert at least one of a textof a first user that is received from the first device 1000 and a textof a second user that is received from the second device 2000 into avoice. The control unit 3200 may determine a tone of a voice that isconverted from the text of the first user, in consideration of userinformation (e.g., a gender and an age) about the first user. Also, thecontrol unit 3200 may determine a tone of a voice that is converted fromthe text of the second user, in consideration of user information (e.g.,a gender and an age) about the second user.

Also, the control unit 3200 may transmit the voice that is convertedfrom the text of the first user to at least one of the first device 1000and the second device 2000 via the communication unit 3100. Also, thecontrol unit 3200 may transmit the voice that is converted from the textof the second user to at least one of the first device 1000 and thesecond device 2000 via the communication unit 3100.

Also, the control unit 3200 may receive a text that is input by thefirst user from the first device 1000 via the communication unit 3100,and may transmit the received text to the second device 2000. Also, thecontrol unit 3200 may receive a text that is input by the second userfrom the second device 2000 via the communication unit 3100, and maytransmit the received text to the first device 1000.

The control unit 3200 may convert at least one of a voice of the firstuser that is received from the first device 1000 and a voice of thesecond user that is received from the second device 2000 into a text.

The control unit 3200 may transmit a text that is converted from thevoice of the first user to at least one of the first device 1000 and thesecond device 2000 via the communication unit 3100. Also, the controlunit 3200 may transmit a text that is converted from the voice of thesecond user to at least one of the first device 1000 and the seconddevice 2000 via the communication unit 3100.

The control unit 3200 may receive a voice that is input by the firstuser from the first device 1000 via the communication unit 3100, and maytransmit the received voice to the second device 2000. Also, the controlunit 3200 may receive a voice that is input by the second user from thesecond device 2000 via the communication unit 3100, and may transmit thereceived voice to the first device 1000.

The control unit 3200 may store a text indicating a conversation betweenusers who perform a voice-message call. The control unit 3200 may storea part and/or all of the text indicating the conversation between userswho perform the voice-message call. The control unit 3200 may obtain atext that is converted from a voice that the first user inputs to thefirst device 1000, a text that is converted from a voice that the seconduser inputs to the second device 2000, a text that the first user inputsto the first device 1000, and a text that the second user inputs to thesecond device 2000.

The control unit 3200 may obtain the text indicating the conversationbetween users from at least one of the first device 1000, the seconddevice 2000, and the server 3000. Also, the control unit 3200 may storea part and/or all of the obtained text in the DB 3300.

The control unit 3200 may store voice data indicating a conversationbetween users who perform a voice-message call. The control unit 3200may store a part and/or all of the voice data indicating theconversation between users who perform the voice-message call. Thecontrol unit 3200 may obtain voice data that is converted from a textthat the first user inputs to the first device 1000, voice data that isconverted from a text that the second user inputs to the second device2000, voice data that the first user inputs to the first device 1000,and voice data that the second user inputs to the second device 2000.

The control unit 3200 may obtain the voice data indicating theconversation between users from at least one of the first device 1000,the second device 2000, and the server 3000. Also, the control unit 3200may store a part and/or all of the obtained voice data in the DB 3300.

The control unit 3200 may generate a call list in relation to avoice-message call between users. Also, the control unit 3200 may matchthe stored text and the stored voice data with the call list in relationto the voice-message call between users.

The DB 3300 may store data for a voice-message call between at least twoof the first device 1000, the second device 2000, and the third device4000.

The voice DB 3310 may store a plurality of pieces of voice data of theusers. The voice DB 3310 may store voice data that is input by a userand voice data that is converted from a text that the user inputs. Also,the voice DB 3310 may store a plurality of pieces of attributeinformation about the plurality of pieces of voice data of the users.The attribute information about voice data may be used to distinguishbetween a voice that is input by the user and a voice that is convertedfrom a text that is input by the user. However, one or more embodimentsof the present invention are not limited thereto.

The text DB 3320 may store texts of the users. The text DB 3320 maystore a text that is input by the user and a text that is converted froma voice input by the user. Also, the text DB 3320 may store a pluralityof pieces of attribute information about the texts of the users. Theattribute information about a text may be used to distinguish between atext that is input by the user and a text that is converted from a voicethat is input by the user. However, one or more embodiments of thepresent invention are not limited thereto.

The call list DB 3330 may store the call list in relation to thevoice-message call between users. The call list DB 3330 may also storevarious types of information about the call list DB 3330. Data stored inthe call list DB 3330 may mutually match with data stored in the voiceDB 3310 and data stored in the text DB 3320.

The exemplary embodiments may be embodied as computer readablecode/instructions on a recording medium, e.g., a program module to beexecuted in computers, which include computer-readable commands. Thecomputer storage medium may include any usable medium that may beaccessed by computers, volatile and non-volatile medium, and detachableand non-detachable medium. Also, the computer storage medium may includea computer storage medium and a communication medium. The computerstorage medium includes all volatile and non-volatile media, anddetachable and non-detachable media which are technically implemented tostore information including computer readable commands, data structures,program modules or other data. The communication medium includescomputer-readable commands, a data structure, a program module, otherdata as modulation-type data signals such as carrier signals, or othertransmission mechanism, and includes other information transmissionmediums.

Throughout the specification, a term “unit” indicates a hardwarecomponent such as a processor or a circuit, and/or a software componentthat is executed by a hardware component such as a processor.

It should be understood that the exemplary embodiments described hereinshould be considered in a descriptive sense only and not for purposes oflimitation. Descriptions of features or aspects within each embodimentshould typically be considered as available for other similar featuresor aspects in other embodiments. For example, configuring elements thatare singular forms may be executed in a distributed fashion, and also,configuring elements that are distributed may be combined and thenexecuted.

While the exemplary embodiments have been particularly shown anddescribed, it will be understood by those of ordinary skill in the artthat various changes in form and details may be made therein withoutdeparting from the spirit and scope of the present disclosure as definedby the following claims.

What is claimed is:
 1. A mobile device that performs a call with anexternal mobile device, the mobile device comprising: a control unitconfigured to obtain text, the text converted from voice data that isexchanged between the mobile device and the external mobile device,during the call between the mobile device and the external mobiledevice, and obtain input text input to the mobile device and providedtext that is received from the external mobile device; and a displayunit configured to arrange the text, the input text, and the providedtext and display the arranged text, input text, and provided text on ascreen of the device, during the call between the mobile device and theexternal mobile device.
 2. The device of claim 1, wherein the text, theinput text, and the provided text are arranged in a temporal order inwhich the text, the input text, and the provided text are received bythe mobile device, and wherein the display unit is configured to displaya chat window comprising the arranged text, input text, and providedtext on the screen of the device.
 3. The device of claim 1, wherein thedisplay unit is configured to display the arranged text, input text, andprovided text distinguishably from each other.
 4. The device of claim 3,wherein the display unit is configured to display a reliability of thetext according to reliability of voice conversion of the text.
 5. Thedevice of claim 3, further comprising an audio output unit configured tooutput original voice data that corresponds to the text, according toselection of the text.
 6. The device of claim 5, wherein the selectedtext is a sentence or a word in a sentence.
 7. The device of claim 1,wherein, when an output method of the external mobile device is changedduring the call between the mobile device and the external mobiledevice, the mobile device receives information indicating the changedoutput method, and wherein the output method comprises a voice-onlyoutput method, a text-only output method, and a voice and text outputmethod.
 8. The device of claim 7, wherein the control unit is furtherconfigured to control the mobile device to output an indicator of thechanged output method to the user of the mobile device by using at leastone selected from a voice, a text, and a vibration.
 9. The device ofclaim 7, wherein the control unit is further configured to recommend theuser of the mobile device to change an input method of the mobile deviceduring the call between the mobile device and the external mobiledevice, according to the output method of the external mobile device,and wherein the input method comprises a voice-only input method, atext-only input method, and a voice and text input method.
 10. Thedevice of claim 1, wherein the control unit is further configured toassociate the arranged text, input text, and provided text with a calllist that comprises a call history in relation to the external device,and stores the call list.
 11. The device of claim 10, wherein thecontrol unit is further configured to store a part of the arranged text,input text, and provided text, and wherein the part of the arrangedtext, input text, and provided text indicates a text that is obtainedfor a preset time period during the call between the mobile device andthe external mobile device before a predetermined event occurs.
 12. Amethod of a mobile device performing a call with an external mobiledevice, the method comprising: obtaining text, the text converted fromvoice data that is exchanged between the mobile device and the externalmobile device, during the call between the mobile device and theexternal mobile device; obtaining input text that is input to thedevice; obtaining provided text that is received from the externalmobile device; and arranging the text, the input text, and the providedtext and displaying the arranged text, input text, and provided text ona screen of the device, during the call between the mobile device andthe external mobile device.
 13. The method of claim 12, wherein thetext, the input text, and the provided text are arranged in a temporalorder in which the text, the input text, and the provided text arereceived by the mobile device, and the displaying comprises displaying achat window comprising the arranged text, input text, and provided texton the screen of the device.
 14. The method of claim 12, wherein thedisplaying comprises distinguishably displaying the arranged text, inputtext, and provided text.
 15. The method of claim 14, wherein theconverted text is displayed according to reliability of voice conversionof the text.
 16. The method of claim 14, further comprising outputtingoriginal voice data that corresponds to the text, according to selectionof the text.
 17. The method of claim 16, wherein the selected text is asentence or a word in a sentence.
 18. The method of claim 12, furthercomprising, when an output method of the external mobile device ischanged during the call between the mobile device and the externalmobile device, receiving information indicating the changed outputmethod, and wherein the output method comprises a voice-only outputmethod, a text-only output method, and a voice and text output method.19. The method of claim 18, further comprising outputting using at leastone selected from a voice, a text, and a vibration an indicator of thechanged output method.
 20. The method of claim 18, further comprising:recommending the user of the mobile device to change an input method ofthe device during the call between the mobile device and the externalmobile device, according to the output method of the external mobiledevice, and wherein the input method comprises a voice-only inputmethod, a text-only input method, and a voice and text input method. 21.The method of claim 12, further comprising associating the arrangedtext, input text, and provided text with a call list that comprises acall history in relation to the external device, and storing the calllist.
 22. The method of claim 21, wherein the storing comprises storinga part of the arranged text, input text, and provided text, and whereinthe part of the arranged text, input text, and provided text indicates atext that is obtained for a preset time period during the call betweenthe mobile device and the external mobile device before a predeterminedevent occurs.
 23. A system that provides a call between a first mobiledevice and a second mobile device, the system comprising: a servercomprising: a communication unit configured to receive a voice of afirst user from the first mobile device; and a control unit configuredto convert the voice of the first user into text, wherein thecommunication unit is further configured to transmit the text to thesecond device; the first mobile device configured to provide the voiceof the first user to the server; and the second mobile device configuredto display the text, which is transmitted to the second mobile device,in a chat window that is displayed on a screen of the second mobiledevice during the call, wherein the chat window displays a conversationbetween the first user and a second user.
 24. The system of claim 23,wherein the server is further configured to store the text.
 25. Thesystem of claim 24, wherein the server is further configured to storethe voice of the first user that is received from the first mobiledevice.
 26. A non-transitory computer-readable recording medium havingrecorded thereon a program for executing the method of claim 12, byusing a computer.
 27. A mobile device comprising: a transceiver; and aprocessor configured to control the transceiver to establish avoice-message communication session with an external mobile device, thevoice-message communication session supporting transmission andreception of voice data and text data between the mobile device and theexternal mobile device.
 28. The mobile device of claim 27, furthercomprising: a display; and an input/output unit configured to receiveinput from a user and output information to a user; wherein theprocessor is further configured to control the display to display thetext data received from the external mobile device as text informationand control the input/output unit to output the voice data received fromthe external mobile device as audio information.
 29. The mobile deviceof claim 28, wherein the processor is further configured to control theinput/output unit to receive text data from the user and voice data fromthe user, and control the transceiver to transmit the text data and thevoice data to the external mobile device.
 30. The mobile device of claim29, wherein the processor is further configured to control the mobiledevice to operate in a voice call mode.
 31. The mobile device of claim30, wherein the processor is further configured to control thetransceiver to receive text data from the external mobile device andconvert the text data into voice data and control the input/output unitto output the converted text data as the voice data, in the voice callmode.
 32. The mobile device of claim 29, wherein the processor isfurther configured to control the mobile device to operate in a textmode.
 33. The mobile device of claim 32, wherein the processor isfurther configured to control the transceiver to receive voice data fromthe external mobile device and convert the voice data into text data andcontrol the input/output unit to output the converted voice data as thetext data, in the text mode.
 34. The mobile device of claim 29, whereinthe processor is further configured to control the mobile device tooperate in a combination mode comprising a voice call mode and a textmode.
 35. The mobile device of claim 34, wherein the processor isfurther configured to control the transceiver to receive text data fromthe external mobile device and convert the text data into voice data andcontrol the input/output unit to output the converted text data as thevoice data, in the combination mode, and wherein the processor isfurther configured to control the transceiver to receive voice data fromthe external mobile device and convert the voice data into text data andcontrol the input/output unit to output the converted voice data as thetext data, in the combination mode.
 36. The mobile device of claim 34,wherein the processor is further configured to control the input/outputunit to receive the input as text data or voice data and output theinformation as text data or voice data.
 37. The mobile device of claim34, wherein the processor is further configured to control theinput/output unit to receive the input as text data or voice data andsimultaneously output the information as text data and voice data. 38.The mobile device of claim 29, wherein the transceiver is configured totransmit and receive the voice data over a voice channel of thevoice-message communication session and transmit and receive the textdata over a text data channel of the voice-message communicationsession.